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FOREWRD 



Occupational supply and demancj data — t^at is^^data which 
show the number of 'workers needed and" the nuntoer being tr'ained 
for a specific job or job cluster--are essential- for effective 
decisions regarding the initiat'ioji, continuation, or termination 
of training programs. If the st;^a£e and nation are to be assured 
that the training provided is ri^evant to the' needs of indivici- 
uals and employers, accurate supply/demand projec^ipkis ,^re 
needed, for use in program planning. 

The project r^port^d here has investigated the problems and 
causes of multiple counting and undercounting in the calculation 
of labor supply. This report offers recommendations that can . 
assist states in more accurately estimating the number of train- 
ed workers that will be ^emerging from th^ foirmal, organized 
training programs operating in the state. 

The Natiohal C^ter for, Research in Vocational Education' 
gfeatly appreciates the support of the National Occupational In- 
formation Coordinating Comraittee (NOICC)^and the National Center 
for Education Statistics (NCES) in the funding of ^ this ^ study . 
NOICC and ,its c'ounterparts, in the states — the. State Occupation- 
al Information Coordinating Committee (SOICC) — ^have been desig- , 
• nated by the Congress as the ^agencies responsible for seeing^ 
that accurate and timely supply/demand in formation ^ is available 
to decision makers at the etate and local levels.. This effort, 
along With other coordination activitiesT particularly t1ie use 
of supply/demand information in decisipns, can be strengthened 
by attention to the finding^ and recommendations of this report. 
A coordinated effort to meet the training ne^^s^^^^. each state is 
necessary if the nation is to be most ef fectuve^lyXgerved in this 
critical area. 

The National Center is particularly indebted to the project 
staff. Dr. Bill Stevenson, Pro ject Director , Sue Allen, E^rogram 
Assistant, Patricia Fornash, Program Associate, Nellie Martin, 
Graduate Research Assistant,* and Venita Rammell , Secretary. Re- 
cognition should also be given to Drl N.L. McCaslin, iAssociate 
Director, Evaluation andPolicy Division, and Dr. Floyd McKin- 
ney. Program Director for Evaluation Services. 

A special note of thanks is extended to, Dr. Janet Spirer, 
Xerox Corporation , Leesburg, Virginia ; Dr . Charles McClintock , 
Professor, Cornell University; and to Dr . Deborah Coleman, Re- 
search Specialist, of the National Center staflf for their in- 
sightful and constructive review of_ the ^inal report. 
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ExfecUTiyE SUMMARY 



Introductipn 



. /■ , ' -^ 

Decision makers in vocational education at the state and 
local leyel need current, accurate-, and relevant information 
upon which to make dercisions, about occupational program offer- 
ings, foremost among these -information needs is^daj:a on^pro- 
jected' demand and supply pf trained yorkers' by job title or. ^ 

■ cluster. Although information on expected salaries (compared to 

• nontrained employees), potential job advancement, necessity of 
the oqcupation to -society, minimum firing recjuirements and other 
infolfnation are important, the gap between anticipated demand 




upply is cr^itical in deciding program formulation, imple--* 
tion, continuation, and termination. 



iPurpose of the Study 



\ 'Ttiis ''study Conducted by the National Center for Research in 
^ Vo,catx6nal Educaiition and sponsored by the National Occupati.orial 
In'foirmatioit Coordinating Committee (NOICC) and the Nat ionS Cen- 
ter fpg Educatior^' Statistics (NCES), investigated' the collection 
^ and a|pi|rtpiration of occupational supply data frftm formal, organ- 
ized t^raining programs. ' . ^ 

I ' ^ > - ■ ■ 

|rh'e primary concern of the investigation ^as to identify 
instances of raultiplfe counting (through two^ or more reporting 
system^)/ and undercounting (through no reporting syj^tem) of 
per sobs trained and available for employment. Two potentially • 
serious issues associated with supply data exist and require 
study and documentation. First, there is a potential for multi- 
ple covinting of students/clients ^erved by^ more than ^one agency/ 
program. Specifically, there is ^a potential for multiple count- 
^in^ between tKe following reporting systems: "Vocatiojo^l Educa- 
tion Data System (VEDS), Comprehensive , Employment and Training 
- Act (CETA), Rehabilitative^ Services Administration (RgA),,^and 
^^Higher Education General* Information System tHfeGIS). A secoild 
and eqiially important issue associated with estimating occupa- 
tional supply concerns individuals who are being trained-and are 
availat>3.e for employment, but are not reported through any sys- 
tem an4 thus areXnot counted as supply. This was thought to oc- 
cur most often ift proprietary schools. Vocational programs not 
^reported and nonvocational programs in the publicf schoo'ls, and 
CBO's. ;This study was not designed to- investigate* any supply 
'COming> from outside the formal; organized training" program* in 
the states. 



ESTI^4ATING OCCUPATIONAL SUPPLY ' ' 

/;CTFORMATION FROM FEDERAL REPORTS: , 
/ I ISSUES AND CONCERNS . " ^ 



ERLC 



Xlll 



Methodology . > 

The study combined the following-: 

..■•V • . ^ ' . \ 

*. o A; review of. tKe relevant literature including re- 
search reports^ laws, regulations , ^ and forms re- 
■ lating to the federal and state reporting syst^ems 

o: Interviei^s wi-'th.-274 individuals >in ten states 

involved in. the production and use of data at the 
state or loca'l level / . ' ^ * 

o tot^rviews and conferences with agency and institu- 
tional representatives* at the local, state, and 
federal level 0^ ■ ' 

o ' Observations in sixty local , training institutions 
or agencies (secondary schools, ct^mmunity colleges 
technical iastitutes, and CETA^ Prime Sponsors) 

Fih^ings • ' . 

"Th^ report presents findings relating to multiple counting 
occuring as a result of the following: 



1. Duplicate counting within an institutio 

2. e> Duplicate counting between agencie.s 




nd 



The report also discusses under ' counting as a result of the 
following: \ . 

^ -1. Failure to secure data on the output of proprie- 
tary schools 

2. Lack of reports on public school's vocational 

programs not in the state plan and nonvocational 
programs producing individuals who a,jre trained 
and available for employment r J 

Some general statements based on a majority of states 
studied summarize the findings on multiple counting §nd under- 
counting. 

o Vocational education is the principal trainer for 
GET A clients, with some training being done by pro- 
prietary schools . ' ^ 

o VEDS reports include those CETA clients who are in 
a regular vocational class, whereas CETA con- 
. tracte^ classes are not generally reported through - , 
VEDS. . ' * 

• o A relcttive small number of individuals receive sup- 
port for skill training through RSA. 

o RSA refers the iitajority of . its clients who need - 
training to vocational education 
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o Vocational education reports RSA trainees in VEDS. 

o VEDS v^ill include most RSA trainees. 

o Conununity-based 'organizations (CBOs) do some 
training of CETA clients. The number receiving 
occupationally specific skill training is not^ 
significant in most state ' s supply calculatic^is . 

o Veterans Administration (VA) supports trainees in 
both vocational education and in proprietary 
schools. 

?• ■ ■'..*' 
o Vocational education rejx>rts .through VEDS thos^ VA 

clients receiving training. ; ' * 

o Data on VA clients trained^^n proprietary schools 

would have to come from VA or proprietary reportjg. 
o Multiple counting occurs between VEDS report and V ^ ' 

HEGIS reports. . * ' - - \. 

o HEGIS reports contain enrollments and numbers re- ' 

ceiving certificates or diplomas, 
o States are aware of, but only, a f ew haVe used, 

Noncollegiatfe Postsecondary Survey (NCPS) data, 
o Programs not traditionally considered vocational 

(indusbrial arts, typing, and so forth) w^re not 

found to be producing significant numbers of people 

trained and^ava liable for a specific occupation, 
o Propriet^ry'^Schools, in most spates, make up the 

largest nunjbers of individjuals trained but not in^ 

eluded in supply calculations. 4 

The report further describes the state reporting systems 
and the flow of data from the local institution to the federal 
level.* Other findings are presented tl>at deal with the human 
factors involved in the generation, collection, analysis^ and 
use' of Occupational supply information. 

• • Recommendations v. 

( ^ — ; — 

The recommendations contained in the repoift may be sum- 
marized as follows: ^ ^ 

1. Supply numbers should be based on number of 
trainees available ,for employment,. 

2. To secure data on prpprietary schools, it is 
recommended that SOICCs do the bailing of the 
Noncollegiate Postsecondary Surrey, receive 
the responses back . from schools , record com- 
pletion data, and send- materiaiL 'on to NCES. 

3. Based on state differeQges, major supply data 
sources; should, be: VEDS, CETA, and NGPS. 



4. CETA reports should be modified to include. the 
• type of institution providing the training and 

whether traiijing' is on- an individual referral or 
contracted class basis. 

5. Every effort shoi^d be made to use spcial secur- 
ity* numbers to identify every individual receiv- 
ing training in any fegieral or state funded pro- 
gram. , . 

6. Numbers of trainees not counted as a result of 
vocational programs which do not fill out federal 
reports, though not s^igni f icant in most states, 
should -be* studied by the state agency responsible 
for caljculating supply. 

^7. Programs not traditionally considered vocational 
(industrial arts, typing ^ and so forth) sh9uld be 
investigated to determine if they -constitute a 
significant source of trainees ni|pt being reported, 



8. At the federal level every effort '^should be ex- 
etted to establish one occupational coding sys - 

<^ tem and one education-training program coding 

system . The NCES uniform reporting system will 
alleviate the problem to sj^e extent, 

9. SOICC Committees should have principal responsi- 
bility for the production of a report that 
matches occupational supply against occupation- 
al demand . 

■ . ' 

10. State procedures should be established to ensure 
involvement of, and feedback to, local providers 
of data. 

11, Research should be conducted to identify ways to 
increase the use of supply/demand data in state 

.and local program plannifi^. 

Finally, the report recommends a method of Analysis of Mul - 
tiple^ Counting that should be used when there appears to be a 
probability of multiple reporting of individuals trained. The 
use of this analysis system is il lustrated in the report. 

Concluding Statement . 

Effective coordination can start with an information systei 
that communicates with all of the providers and funders of 
training that grows into an organized cooperative program to 
meet the job preparation efforts of the state and nation* The 
information systems that can spark and guide this coordinated 
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effort need not be one system but if the several data mechanisms 
ace to foster communication they must speak the same language. 
Th,e implementation of uniformity of language, which seems so 
obvious and yet has proven to be so elusive, requires time, 
effort, and leadership at all levels — local, statfe, and nation- 
al. This achievement of communication requires the elimination 
of barriers and the construction of bridges of cooperation. 
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CHAPTER I 
RATIONALE AND INTRODUCTION 



Thi^ study conducted by the National Center foar^esearch in 
Vocational Educatioo^and sponsored by the National^Occupatipnal 
Information Coordinating Committee (NO ICC) and the National Cen- 
ter for Education Statistics (NCES) investigated the collection 
and pompilation of occupational supply data. This particular 
research was limited to that part of the occupational supply 
data, that is representative of those iliaividuals entering the 
labor market as a result of skill traimthg obtained through a 
formal, organized settihg. The m^ajor training providers in this 
situation are vocational education, proprietary schools, anjd to 
a limited extent, community-based organizations (CBOs). Funders 
of training are the .Comprehensive Ertiployhient' Training Act 
(CETA), Rehabilitation Services Admi'histration (RSA), Vocational 
Education, ' Veterans Administration, dnd the Bureau of Indian Af- 
fairsf. 

The pFimary concern of the investigation was to identify- 
instances of double or multiple counting (through two or more 
reporting systems), and undercounting (through no. reporting sys- 
tem) of persons trained and* available for employment. Each sys- 
tem, e.g., CETA and Vocational Education, must account for all 
of the participants it serves and include these individuals in 
thqir reporting system. The issue of multiple counting arises 
not because the reporting systems are in error, but occurs only 
when data from different systems are used in developing supply 
estimates V Similarly, the fact that some training prograuns are 
not included in any of the reporting systems does not inherently 
indicate a flaw in the reporting, but only that such training is 
outside of the purview of the existing systems. In short, this 
study is not intended to examine any possible shortcomings of 
existing reporting systems, but rather analyzes the prob>lems 
that occur in the application of data from these systems for es- 
timating supply. This reserarch identifies needs and ^t>ncerns as 
perceived by the principal actors in the ten states studied, as 
well as those needs and concerns dbserved by the researchers. 
This study is not designed to investigate any supply coming from 
outside the formal, organized training programs in the states. 

Information for Decisions 

a -. , 

* . . . ' 

'Decision makers in occupational trainiijg at the state and 
local level need current , accurate, and relevant/^information 
upon which i:o make decisions about occupational /program offer- 
ings. Foremost/ among these information needs ire; data on the 
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projected demand and supply of trained workers by job title 
or cluster. While expected salaries ^ ( compared to nontrained 
employees), potential job advancement, necessity pf the oc- 
cupation to society, minimum hiring requirements, and other 
information are important, the gap between anticipated demand 
and supply is critical in decj-din^ program formulation, imple- 
mentation, continuation, and termination. ^ # ^ 

Based on this need, a primary legislative charge of the 
Education Amendments of 1976 to the National Occupational Infor-^ 
mation Coo^rdinating Committee (NOICC) and the State Occupational 
Information Coordinating Committees (SOICC ) was the development 
and implementation of an Occupational Information System (OIS) • 
The'* legislation further stipulated that OlS "shall ' include data. 
XDn" occupational demand and supply based on uniform definitions, 
standardized estimating procedures, and standardized occupa- 
tional classifications V* To initiate the OIS development pro- 
cess, several basic policy determinations were^^ade. ,Among'them 
was the- policy that NpICC/SOICC would not beco\ne a primary .d^ta • 
collection agency put rather, coordinate sucl) ^ef forts among itV 
member agencies. Following this policy,, NOICC/SOICC planned to 
Utilize data and information from th^' following sources in de- 
veloping pccupational supply data:* . 

Employment and Training Administration's data'' . 
repoifting systems, i.e.. State and National 
Apprenticeship System ( SNAPS )^, Employment 
Security. Automated Reporting System (ESARS) , ^ 
Employment and Training programs reporting^ 
system, \:eTA, and Job Corps. ' , ^ 

State Employment Security Agency programs, i.e.,^ 
Employment Service (ES) and Unemployment Insut- 
an^e Service (UIS) . ' 

Rehabilitaticm Services Administration's Case 
Service Reporting System (CSRS). • ' 

National Ce^itter for Education Statistic's data 
reporting systems , i.e.. Vocational Education 
Data System (VEDS), Higher Education General 
Information Survey (HEGIS), and Noncpll^giate 
Postsecondary Schools Survey (NCPS)'i. 

At the start of the research reported in this document two 
major issues and a number of questions were obvious ti^ the re- 
searcherp. Two potentially serious issues associated wi€h the 
use of the above systems as the source of s^ipply data may exist 
"and require study and documentation. First, there is a poten- 
tial for multiple' counting of students/clients served by more 
than one kgency /program. Specifically, there^s a potential for 
multiple counting between' the following reporting systems; VEDS, 



SI? 

2. 

3. 
4. 



^ . ' 18 



CETA, RPA, HEGIS,^, and Job Corps. ^'or example, ai^e significant 
numbers of CETA participants attending piibLic vocational insti- 
tut,ions being reported both through VEDS and«t2ETA? This issue 
may complicate attempts to estima'te supply since these counts 
will duplicate those that will be rejported through the^ CETA' re- 
porting system that is being implemented this year. 

A second a'nd equally important issu^ associated witli esti- 
mating occupational supply concerns individuals who are being 
trained andf available for employment but not reported through 
any system and thu-s^ not counted as supply. This tpay occur 
through the limiting of VEDS reporting to programs covered by 
the state plan, \.e., programs, for which federal vocational edu 
cation funding is provided. State plan coverage may vary sigpi 
fickp=41y from state to state, especially in the postsecondaigy 
area, because of the organization and funding structure within 
stat^*. Another reason tor undercouqting ma^ stem from the fact 
that some states are not obtaining data on proprietary schools. 
As a general rule, when developing procedure^ for estimating oc 
cupational supply, it is essential that all major sour:ces of 
training be covered or, at least, that tliey be treated in a con 
sistent^ manner. 

....Questions that must be answered aboirt these two issues are 
as follows: A ^ ^ 

V > 

1. Under what organizational structures ^and state 
'training and reporting conditions are signifi- 
cant multiple* or undeircounting problems likely to 
occur? o 

2. How rriay a state identify and account for sources 
of multiple counting or undercounting suppfly from 
institutional traiiSsLjig programs? \ 

3. ".Wtiiatypr should a** state use to Secure 
0C^0^^t data if quesjiions ^( 1 ) and ( 2 ) indicate 

ct^t^^liliif ic problem exists in the present data? 

4. Wh^t suggestions should be offered at the fed- ^ 
eral level for improving^ the quality of the * 
supply dat^ in an occupational information sys- 
t^em? • * 
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Procedures for the Research 



The procedures employed in t;he conduct of this study con- 
sisted of a revi^ew of the literature related to compilation of 
9upply/demand data, collection and analysis of reporting forms, > 
and a study of the law:s;^nd regulations pertaining to federal 
reporting systems. En^^^^dition, project staff spent two weeks 
in each of ten states liiterviewing MIS and administrative staff 



of training agencies a^t i the stat^ and local*»level . A steering 
conunittee representative federal and state agencies involved 
in 'occupational training and an advisory panel of specialists in 
the National Center for Research i%n Vocational Education assist- 
ed with direction of t^fie study and review of the fin^l report. 
More details on the methodolcrgy of the study may be found in 
^ chapter 2 of this report. • p . , ' ^ 
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Organization of the Report 



/ 



The next chapter of this report will present the method- 
ology. This is followed by a chapter on the findings resulting 
from the state visits, and the revieVs of the reporting systems . 
The last chapter includes the summary, Conclusions, and recom- 
mendations\ For details on related literature, and relevant » 
federal laws the reader ^s referred to Appendix A ^nd B of this 

study was written on each of the states 
The individual state case study has 



report. Finally, a case 
included in the analysis'. 



been made available to the agency%^ staff in that state for their 
us'e and is not included in this "report • 
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CHAPTER « II ^ 

METHODOLOGY^ <i 

A series of activities were scheduled in completing this 
study. The activi-ties included consultation with appropriate 
National Center staff, reviewing pertinent literature and docu- 
ments, constructing conceptual framework, convening an external 
steering committee, vis iting states ^ analyzing exi sting data 
base, analyzing reporting forms and instructions, and analyzing 
information using the cape cluster method.' 

^ National Center Consulting Panel * 

A National Center Consulting Panel was selected to work 
with the staff on the project. The panel members w^e selected 
because of their background and*^xpertise in the following 
areas: (1) state vocational management information^ systems (2) 
CETA, (3) labor market data, (4) rehabilitatiorj^service ^gency/ 
(5) communLty based organizations, and (6) cq^munity colleges. 
^This "in-house" consulting panel reviewed the plans for the 
s£udy, made recommendations for types of persons within certain 
agencies to be interviewed, and reviewed the draft report. The 
panel also provided the project staff with certain relevant 
pieces of ,liter^ure to be incorporated into the sti^dy. Coin- 
ciding with the selection of the National Center Consulting Pan- 
el, the literature and document reviews were ini.tiated 

Conceptual Framework 

In order to understand the reporting systemfe^;and to analyze 
those systems for clues to improvements, it appeared to be rea- 
sonable to look at the laws and regulations' pertaining to those 
systems, the pepple operating the systems, the substantat ive 
content of the systems, and how the people operating the systems 
interact with each other. This framework guided the course of 
the study and formed the base for the activities whioh followed. 

The staff reviewed the laws which created the Various agen- 
cies and the regulations of the agencies establishing a report- 
ing system. Interviews conducted at the local and state level 
provided' insights into the skills and the attitudes of the peo- 
ple operating and using the information systems* The substanta- 
tive content of the systems was studied through the collection 
of reporting forms and complet^ed reports. Conversations^ with 
local -training staff and* with local reporting people revealed " 
much about the content of the reports • The interaGtion of the , 
individuals operating the system was highly varied both within 
and between agencies'. The "iiuman factor" was found to be an im- 
portant factor in determining both the quality of the data and 
the extent of its uSe. " * . • • 



Literature Review 

-%. • ^- r 

^The literature review was conducted to identify prior re- 
search in the area of labor supply reports for trained workers, 
to identify existing information relevant to the projects re- . 
search questions, and to determine where additional information 
is needed to extlend or modify currei^ methods of gathering labor 
supply data on tk^ined workers. (Ap^ndix A.) 

The literature review, focused on labor supply Reports,, 
rather tha^n the labor demand information. This decision was 
made because of (1) the focus of the study was l^bor supply in- 
formation reporting systems and (2) the voluminous number of 
labor demand reports. 

The literature review was ^initiated by a computerized 
search of two data bases: Educational Resources Information 
Center (ERIC) and Current Inde'ices to Journals in Education ^ 
(CUE). Other pertinent literature was suggested by'N^OICC s^aff 
members, the steering committee, and the National Center con- 
sultir^^ panel . . ^ 

External ■ Steering Committer > * 

The external steering committee represented diverse agen-r 
cies involved in labor market information collection and usve. 

'(see Appendix D. ) They were collaboratively selected by sponsor 
staff and project staff ^nd were convened for 'three separate 
raeetirig^s at the NOICC office in Washington, D.C. At the first 
meeting of the steering committee the project staff provided an 
orientation to the project. The steeriftg committee helped in 
determining areas where under cojjnting and multiple counting may 
be ocetjNnringt in identifying important issues for the study, and 
in providing project -staff with infor^fnation about training and 
reporting procedures in each of their agencies. At the second 
meeting the project staff gave an overview of their impressions 
of the states that had been visited to date. The steering com- 
mittee members reacted to these impressionis and recommended 
other infqrmation that should be ^acquired • At the last meeting 
of the steering committee, the project staff presented at draft 
of the final report for the committee's reactions. The steering 
committee offered ideas and suggestions to be incorporated into 

-the final report. 

Site and Interviewee Selection . 

In selecting the ten states to be hsed for in-depth examin- 
tion," consideration was given to urban/rural factors, data col- 
lection and reporting processes, governance structures, fundi^ng 
process, /availability of CETA Prime Sponsors, existing written 
policies for submitting reports, and actual published reports of 



data including supply/demand information. For this reason, the 
ten states to, be surveyed were sel^ected using a purposeful samp- 
ling procedure. The first step used in the site selectiop was 
to* identify the appropriate variables as mentioned above tha^t 
.may. lead to multiple or undercounts in supply. The final selec- 
tion was coordinated with NO ICO. 

The following states were includeci in the study: (l) Cali- 
fornia, (2) Connecticut, (3) Florida, (4) Illinois, (5) Minne- 
sota, (6) Missouri, (7) South Carolina, (8) Utah, (9)' Virginia, 
and QO) Washington. 



, After^selecting the states to be visited, project staff de- 
termined the criteria for local site school selection. ^n each 
state two secondary and two pos tsecondary .^schools were select-* 
ed. The schools and the prime sponsors were to be located with- 
in a hupdred mi,le radius from the state .capital and within fifty' 
miles fxom each other %henev«r possible.' The secondary schools 

would include urban areas of fering five or more vocational 
prMftrams and rural areas with at least three voqation^l pro- 
grams. The postsecondary institutions would be representative 
of both community colleges and vocational-technical schools. A 
school with a high percentage of disadvantaged was included in 
each state sincjs? students in these schools would most likely be 
funded from , mo r (I than one service. The fthal selection of the 
local schoolk and prime sponsors was determined by the state 
liasion persJin after project staff discussed the selection 
criteria wit^ them. 

Approximately ten days were sperife collecting information 
and data within each state. During this phase interviews were 
conducted with appropriate state and local administrators, man- 
agement information ' specialists responsible for developing and 
reporting student data, and with the personnel responsible for 
reporting to. the Rehabilitation Service Administration R-300 re- 
porting, system. Interviews were also to be conducted with ap- 
propriate personnel ^t two CETA Prime Sponsors in each state and 
with state CETA (Balance. of State) Personnel.* When the CETA re- 
gional office was located in the capitals of the states in- 
cluded in the project, staff visited those regional^o^fices . 
(see figure 2.1.) 




Positipn Ten State Total 



Cj^TA Prime Sponsors 



CETA Balance of %State 

Director 
Planner 



SOICC Director and Staff 18 

State Vocational Education Director 10' 

State Vocational Education Planner .15 

State Vocational Education MIS person ^ 20 

State Postsecondary Director , ^11 

State Postsecondary MIS person ' , 15 



} 



Director • . P 7 

MIS * ^ 16 

Training Dire^^tor ^ 7 



2 

' 1 

MIS * '13 

Training Director 0 

RSA staff " ' 

Job Corps staff - 3 

Employers 15 

Union personnel " ^ 

Other personnel iS^ 

CETA Regional MIS Staff / 3 

Proprietary Regulating Agency staff 8 

Local Secondq.ry Vocational Educati^ Director 1? 

Local Secondary Vocational Education MIS person 15 

Local Postsecondary Vocationa 1 Education Director 22 

Local Postsecondary Vocational Education MIS person 16 

TOTAL ' 274 



Figure 2.1 Agency Staff Interviewed 
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An adaptation of case study methodology was\planned to 
gather information from the sample .states . ^ Information was. col- 
lected using a case' cluster .method of qualitative case studies. 
A ^framework for this method was provided in "Applying ^ the Logic 
of Sample Surveys *to Quialitatxve Case Studies: The Case Clu'ster 
Method" (McClintock, Brannon, Moody, 1979). The* case cluster • 
method , was chosen because it allowed (1) the definition, enumer- 
i ation, and sampling of units of analysis with the case study? 
(2) the stratif ied sampMng of data source's based on thgeoretical 
grounds and on features of tlie^^^^sase, crossed, with a stratified . 
sampling of units of analy\sis; and (3) the crea^tion of a quanti- 
tative-data s^t , consisting of standardized codes for variables 
pertaining to each unit of arlalysis. This -allowed for a mixtui?e 
'Of jqualitative and quantitative data. By combining qualitative 
data from the case studies, quantitative data^ from the analysis 
sheet, and an existing data base, the project staff was able to 
triangulate findings using the case cluster met>fod. 

An interview guide and data analysis plan were developed. 
The interview guides were developed for all expected respond- 
ents. The data analysis plan included those variables tha^ were 
felt to have some impact on data collection and quality. (see 
Appendix E. ) v 

In order to accomplish the goals of the project, the 
staff used a management by objectives (MBQ| method. Using this 
approach, with assistance and training by%he project director, 
each staff member developed the goals 'and objectives for their 
area of responsibility. - ^ . 

Staff Training 

A week of staff training v^a« cotTipleted before beginning to 
collect data in the field. The project director and a?^^nsul- 
tant held worksjftops with sitaff onjjMBO and the case cluster meth- 
^od of qualitative case studies, respectively. 

A 

The data collection procedur.es were ^piloted by project 
staff and sample cas^ studies were written. Staff talked with 
a variety of representatives in the State Education Department,' 
SOICC, and local school MIS persons ^t the secondary and post- 
secondary level in ^e pilot state. Problems with* the interview 
guides and with achieving researcher uniformity were ;reviewed 
and clarified by staff. With all the elements for the study in 
^ place, the project staff began to plan for the state visits. 

Data Collection Procedures 



Prior to the state visits a. letter was sent to the state 
chamber of commerce, and the directors of commerce, community 
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a£f a jrs , e€onoml| 
quest demographjyl 
pleted prior to || 
t2) socio-econo||| 
on edch- seledtelil 

■ f ■ • . ^ , ■ 

, : . VocationalfeduCation directors and SOICC directors 



development; and ecory^mic opportunity i t/O 
^formation. A d^fetnographic overview was coin- 
acrh state visit. This includecj (1) geographiG,- 
c, (3) education, .and (4) economic infopniation 
state site. * ^ .. 



[cted to .elicit their support for the. pro j* 



'liaison person to be appointed ta,help 



)r . each 

^ordin- 

\to a 



^state were cant 

and:t/:> ask for|^^. ^ . ^ 

ate the activij|3.es in each state; ^Project staff assignee! 
particular st^^-. contacted the appointed liaison'^ person byy^phane 
and letter. in|e\ data for the visit, the persons to be inter- 
viewed, and 
and- interview 

opportutiity . to^ork with. fea<:h of 




criteria fqr local site selection were discussed 
hedules' werfe. set 



up. Each s^taf f member: had\ the 
the^ other statf members^ 



help ens^ure infe»rviewer uniformity 




from each sftfite were in- 
(figure 2.1.1 A ca^e 



An . aver age^l^f twenty-seven^^^JP^^-sons 
terviewed, resu&ing in 274^p^rviews 

study was'^writtll after alj^bcuments and intervirews li^^d beeri^ 
collected and rlliewed^ig^Cach state. The case studied then re- 



presented a comfl^^site g^^ture of inforjyo^Jiion about each state^ 
based ^ intervil^s, jgp^ervations , arid documents. A draft coj^y 



of .Ikiftllase stu(^ JS/N^^^mailed to the SOICC' director/ and yoqar \. 
tional MIS direcl|D^in eadv state to ensure that the casfe^ s|tua]^ 
provided a clear^i^cture of the information' collected. 



specific l;|p?rinatiOn from interviews was recorded on t 
data analysis J^llliis and was processed for analysis across 
States, vrespq^e! 
and postsecqp^a 
eXisl!^^ng da 
greater in^^ 



the 
the 




groups, local and state levels, and secpr 
levels* One final "effort, an anal^^sis of 
on state education , personnel was studied 
o the state s^ituation. 
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Assumptions 



TholiollowiJ 



f inmngs 



assumptions underlie the research strategy! of , 
and cIMtribute to a framework for interpretation of| 



r 



A poteit^ial 'exists for overlap and multiple 
counti|ii students/clients served by more than 
one ag||icy/program. « The potential for , overlap/ 
multifS;! counting exists between the following 
' riportlig systems: CETA, RSA, Job Corps, and the 
'VEDff, and Noncollegiate Postsecondary t 

Surve:^of NGES.- ' ■ ^ ^ . 



A pbtdiTi|ial exists for undercounting of students/ 
clien^^ The potential occurs in prograrqs in 



public pphools not covered 



al plstrimnd in proprietary 



by the state 
sch6ols. 



vbc^ion- 
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3. 



6. 



NOICC is not a primary data collection agency, it 
utilizes data and information from the Employment 
'and Training Administration's data reppr ting sys- 
tems, State Employment Security Agency programs. 
Rehabilitation Services Administration's Case 
Service Reporting System^ and the National Center 
for Education Statistic 's data reporting systems 
including Vocational Education Data Systeirf (VEDS) 

Studying the "agencies" that are the primairy data 
collectoirs will yield information relevant |t6 
mult iple/undercoun ting of trained workers. 



Although data collection, limitations of tiine, and 
funding prohibited visiting of all fifty states, 
careful selection of sites yielded information suf- 
ficient to indicate the types^ of problems that 
be encountered when using data from existing 
reporting systems in estimating supply . 

Respondents interviewed provided serious and hon- 
est answers that were representative general 
views of issues and concerns held by educational 
leaders and training staffs. » 
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Limitations 



The following limitations affected theVpeople of the in 
vestiejation and are germane to the intetpretation of report 
findings : ^ 

1. The site investigation was limited to ten states 
by constraints of time and funding. 



The seleiption and use of a/i analysis plan that 
identified a limited number of factors expected^ 
to have an/impact on over /under counting may have 
af fected|^^indings (These factors are- shown in 
Appendix E.) v 

Investigation at the local level was limited to 
two secondary ajiij postsQCondary schools, and two 
local^ CETA prime sponsors. 

./ • . - ' ■ . - ■ 

The great variation in data collection methods , 
between and within states limited the amount of 
generalizable information. 

Some questiohs investigated were limited to the 
knowledge of the persons identified and inteir- 
viewed by the project staff. 



The findings in the report are conclusions drawn 
from the state agencies, and institutions included 
in the study. Th^se ^conclusions should be tested 
again and again in the every changing contest of 
the training systems, participants/ and agency 
linkages in place in each state. The study will 
identify the problems that are most likely to occur 
and indicate the magnitude of problems that might 
ocqur. 
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CHAPTER III 
\^ FINDINGS 

Introduction 

This study was designed to find ways to improve the quality 
of the education and training portlon/of the supply data that 
goes into the occupational information system (OIS) . Adminis- 
trators need to know not only the number of 'new workers ^who will 
be needed in an occupation but also the number being trained to 
fill those jobs. The project reported here included input from 
federal agencies involved in providing training and collecting 
training data. A description of each of the repoting systems is 
presented later in this chapter. Training and funding agencies 
in ten states were studied to gain an understanding of the re- 
porting systems in operation. Finally twenty secondary schools , 
twenty community colleges or technical institutes, and thirty 
CETA Prime Sponsors and Balance of State units were studied jto 
more fully understand \rt(hat is reported and how the 'system works. 

Project staff at the conclusion of this study have a dis- 
tinct impression of three separate worlds- — federal, state, and 
local — with persons in each fully believing they understand and 
communicate with the other when JLn reality images of each held 
by the other are vague and messages garbled. Local officials 
feel a heavy data burden and do not seem to understand the . need 
for or use of the data. States are caught between lobal reluq- 
tance to report ai%d expanding data expectations at the st^te and 
federal level. Federal agencies construct instruments and write 
definitions only to be met with a stated need for "clearer 
instructions and uniform definitions." Quality and use of data 
are in danger of being shunted aside by the struggle to comply. 

The problem of multiple counting only appears when data 
from two reporting systems is combined. Each system, designed 
to provide data required by a single agency , may be effectively 
meeting that need, whereas if combined with another report could 
result in multiple counting of certain individuals* The solu- 
tion lies not in causing either agency to reduce the numbets re- 
por-^d but^in designing a method of determining, the overlap and 
accohnting "^for it in the final supply calculations* 

The SOICCs are a new attempt to solve this coordinatibn 
and data use problem. With no turf to protect ,; with i^o tradi- 
tions to limit, and with administration by the agencies to be 
coordinated SOICC has an opportunity to start the communication 
so essential to effective cooperation. 
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This chapter presents the finding of this study in terms of 
(1) problems and causes o£ multiple counting of trainees as- 
sociated with using data from the various reporting systems to 
estimate supply, (2) problems and causes of under counting of 
trainees and the effect on calculating supply, and (3) a de- 
scription of how the reporting systems operate. As will be ob- 
/ vious to the reader, there are many independent actors in this 
vast arena with their own needs and their individual perceptionso 
of the whole. This chapter should be useful in getting a better 
» picture of the whole as well as providing clues to. solving the 
problems inherent/^in calculating total supply data within a 
state or area. 

Multiple Counting 

Multiple countiijg occurs under two distin<5t and different 
circumstances. 

* ■ 

1. When an individual is in. two training programs 

in a single institution (welTding and auto mechanics) 
and is reported as prepared and available for ' ' 

-employment in both occupations , 

V 2. When an individual in training is . reported through , 
two reporting systems (CETA and VEDS), both of 
which are used in calculating supply <f/^ 

Duplicate Counting Within an Institution 

The first instance of duplicate counting usually occurs 
when one student wi'thin a single institution or agency is enrol- 
led and reported in^two programs (an auto mechanics student tak- 
ing a welding class). This problem can usual ly ^be most effi- 
ciently corrected by the training institution. Since students ^ 
are required to state an occupational objective the basic rule 
should be only to report the student as trained or preparing for 
that objective. ^"Mi^^re no occupational objective is indicated it 
will be necessary to determine where the greatest concentration 
of work has occurred. 

The most efficient way to identify students participating 
in more than one occupational training program is through the' 
use of social security numbers . The computer can quickly* iden- ' 
tify duplicate social security numbers and the student's name 
carl be removed from the supplemental class listing. This system 
can be implemente'd at the state level. _ 

Manual matching at the local level either by name or social 
security number is an alternative where computerization is not 
in effect. Since VEDS requires an , unduplicated count of voca- 
tional students, most state vocational departments have deve- 
loped methods to accomplish this. In the states studied in this 
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project estimates or actual counts of duplicate enrollments var- 
ied from a low of 10 percent to as high as 50 percent. Those 
responsible for determining supply should use unduplicated 
counts or at least make some adjustment to account for this 
factor. 

/> 

Decisions on how best to el^iminate duplicate reporting as 
discussed above depend heavily on whether or not the state has 
an individual student accounting system (ISAS). A state ISAS 
means that the state received a report from its local institu- 
tions on . each individual participating in vocational * education. 
This 'report, usually is submitted at the beginning of training 
and includes information such as age, sex, race,, handicaps, pro- 
gram, and occupationa,l objective. Computerization allows the 
State to handle the mass of information oh all individuals re- 
ceiving training by* having individual identification numbers 
such as Social Security. 

. States not having an individual accounting system receive 
reports on total numbers enrolled in each program. This system 
provides for much less flexibility in the analysis of student 
data and greater dependence on the local institutions to eli- 
minaite duplication between vocational programs. 

Half of the ten states studied in this project have an I?AS 
and half are recording enrollments by total program. Dif-fer- 
ences in duplicate or double counting were not observable be- 
tween th^se two systems, but methods of avoiding duplicate and 
multiple counting will of necessity be different for states us- 
ing the ISAS or total class reporting system. Undupi ideation 
either between classes or between training and funding agencies 
would be possible at the state level with individual student re- 
cords that have a social security tjumber associated with each 
trainee. This unduplicatioh of count would* have to be carried 
out at the local level in states not having an ISAS. 

Figure 3.1 summarizes the individual state vocational 
education system as it relates to how student data is reported 
from local schools to the state and the method of unduplicating 
student counts within the institution. 

» ^ 

Multiple Counting Between Agencies ' 

The occurrence of multiple counting between agencies is* . 
more dif-ficult to ascertain "^nd probably more significajit in its 
effect on supply figures. This multiple counting occurs when an 
individual is being trained by one agency and that; training ife . 
bein^ funded and reported .by one or more other agencies. As^has 
been mentioned earlier, classroom skill training is generally 
provided by vocational education (comprehensive high schools. 



State' 




2 


3 


4 


5 


Reports used or 
planned for use 
for supply report 


VEDS 
CETA 

Postsecondary 

Non-collegiate Survey (NCPS) 
HEGIS (possibly) 


VEDS^ ^ 
NCP^nd report 

include 

CETA 

RSA 

HEGIS 


VEDS 
^HEGIS 
NCPS 

CETA ♦ 
Defense Dept. data , 
SNAPS/2nd report 
RSA, Job Corp 


veDs 

CETA 
SNAPS 
HEGIS 
NCPS 
• RSA 


HEGIS 
CETA 

VEDS/2nd report 
Job Corp 

/ 


Methods used 
to unduplicate 
report 


Only use CETA students 
not trained by 
vocational education 


No system 


\/ . 

Hantd-check data 
for accuracy and 
to'eliminate 
double counting 


Iflentify * 
source pf , 
funder and 
trainer of ^ 
students 


No system 




6 


7 ' 


^8 


9-10 




* 

i 

a 


VEDS (Secondary) 

HEGIS 

CETA 

Expanded NCPS 

Report 

Job Corp 


VEDS 

HEGIS 

RSA 

Job Corp 
CETA • 
Military 
NCPS 
SNAPS 
Employment 
Security 


VEDS 
CETA 


These states 
are establish-, 
ing a network 
of inter- 
related agency 
data systems. 


i VP 


\ 


. Exclude VED (postsecondary, 
but footnote if VEDS-HEGIS 
differ greatly, only use CETA 
class summary data. 
RSA excluded since all 
training sub-contracted. 


No system 


May use Social 
Security numbers 




- 



f 



Figure 3.1 
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Reports Used to Calculate Supply by SOICC 



technical schools and institutes, and community colleges), pro- 
prietary schools, and to some extent community^based organiza- 
tions. Those entities . that provide funds for twining are CETA, 
RSA, State Board for Vocational Education, Veterar/'s Administra- 
tion, and Bureau of Indian Affairs. The major aiTeas o-f poten- 
tial duplicate counting that might inflate supply data appear to 
be between the following: 

Vocational Education (VEDS) ,and CETA 
t Vocational^ Education (^VEDS) and RSA 
Vocational Education (VEDS) and HEGIS 
Proprietary Schools (NCPS) and CETA 

The funding of training programs .and support for individuals in 
training come from many sources as illustrated in Table 3.1. 
Administrators interviewed about multiple agency funding identi- 
fied several sources of. funds. ^ 

V 

Table 3.1 ^ 



Percent Indicating Sources of Funds for Programs 



Sources of Funds 



Training 
Agencies 


CETA 


BEOG 


Reh&b. 


VETS 


WIN 


Othe r 




Local P-Sec. 


95 


50 


77 


77 


23 


23 


(n 


= 22) 


Local Sec. 


70 


8 


13 


8 


4 ■ 


13 


(n 


= 22) 


CETA 


100 


16 


19 




16 


10 


(n 


= 19) 


State *Sec. 


100 


3 


34 


19 


.3 


0 


(n 


= 14) 


State P-Sec. 


.100 


' 31 


56 


56 


25 


. 13 


(n 


= 13) 



Major funding sources cited by the local postsecondary 
school interviewees were CETA, Rehabilitation, and VETS. Local 
secondary school respondents noted CETA as the major funding 
source. Eighty percent of CETA' staff reported their clients re- 
ceived funds from another source in addition to CETA. All state 
postsecondary and secondary vocational education administrators 
reported CETA as a funding source. When state and local admin- 
istrators and MIS directors were asked to estimate what percent- 
age of the students were funded by more than one agency, four of 
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five reported between 0 and 2 5 percent. Most interviewees re- 
ported that if students received funds from more than one source 
they would be reported more than once. Interviewees said that, 
these reports would be sent to a variety of agencies. 

Multiple reporting between VEDff and CETA > The multiple re- 
port ing'"of"^stljd^nt^~ai^^ numbers in the^ 
VEDS and CETA reports than elsewhere. This is ^ased on the 
facts that vocational education programs are the major trainer 
for gwrk clients, -a large portion of CETA clients . are included 
in the VEDS report, CETA clients are not identified ^epafately 
in the VEDS reports, CETA reports do not identify clients 
trained in public schools , and both the VEDS report and the CETA 
reports are available for inclusion in the supply calculations.. 
In the ten states studied it was reported that vocational 
education provides training for approximately 75 percent of all 
CETA plients receiving skill training. A few exceptions were 
noted in that CETA Prime Sponsors in one state reported it 
percent of training done by community-based organizations (CBOs) 
^whereas in another state. CETA reported that proprietary schools 
train 35 percent of their clients. The majority of the. Prime 
Soonsors and Balance of State operations reported that from .80 
percent to. 100 percent of their referrals to vocational 
education are on an individual basis rather than contracted 
classes: Two Prime ^ppnsors reported a different arrangement, 
indicating tha^t 60 percent and 80 percent o£ theiX clients 
received skill training through contracted classes . Thus the : 
potential for picking up the same individual twice (once through 
the CETA report and once through VEDS) is a strong probability 
if both reports are*used to calculate supply. / 

The development of a process for accurate-ly estimating the 
supply and demand of " trained workers requires a great deal of 
study and work, however the analysis of the states' reporting 
systems in this study shows that eight of the ten states areyor 
plan to report occupational supply and demand data. Two of the 
■states will develop a network of agencies to provide data and 
information at the time decisions are being considered. All of 
the eight states . developing supply/demand data report that they 
use both CETA and VEDS reports in their calculations./ One state 
uses only total class data from CETA and another redu|:es the^ 
CETA report by the number of CETA trainees reported by vocation- 
al education. The other six states using both CETA and VEDS re- 
ports did not identify a method of reducing th^ multiple coun- 
ting. ^ 

All ten states indicated that CETA clients in regular voca- 
tional classes are included in the VEDS report. States do not 
report those individuals trained in a contracted class supported 
fully by CETA funds. The VEDS instructions state that all stu- 
dents in a program supported by VEA funds (State Plan program) 
should be included in the VEDS report. It appears that states 
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are correct in reporting CETA individual referrals and if any 
vocational education resources (buildings, equipment, 'teachers) 
are involved in CETA contracted classes tj^se should also be 
contained in tlie VEDS report." In nine of the^ten states CETA 
officials indicated that individifal referrals made up the major- 
ity of the training done by yocationaiL^ education and that the 
number in contracted classes is declining^ This information 
indicates that the agency or individual responsible for es- 
timating supply should (1) use only CETA contracted class re- 
ports, or (2) reduce the numbers reported by vocational educa- 
tion to reflect individual CETA trainees. 

Multiple reporting between VEDS artd RSA . Reports from Re- 
habilitation Seryices Administration (RSA) and VEDS is another 
potential source of multiple counting • Vocational education is 
the major trainer for ^SA clients who need skill training in 
preparation for employment. These RSA referrals to vocational 
educ/ation are included in the VEDS report. Only two states out 
of the ten visited Indicated that they will be using the RSA re- 
pprt in calculating supply. Since RSA staff intervtevji^d in the 
ten states indicated that vocational education does practically 
all of the skill training for their clients, and since vocation- ^ 
al education reports all RSA clients in VEDS it can be concluded 
that VEDS includes most if not all RSA trainees. Except where 
unusual circumstances exist such as a ^najor training^ef fort out- 
side vocational ekiucation the RSA report can be excluded from 
tliose used to secure supply data. 

Multiple reporting between VEDS and HEGIS . VEPS and HEGIS 
will report many of the same people trained because both report 
postSecondary students. Both reports list individuals receiving 
vocational training at the postsecondary level--VEDS reports the 
number enrolled and those completing approved vocational' pro- " 
grams, whereas while HEGIS includes all those receiving a diplo- 
ma or certificate. Both reports cover community colleges and 
• two^ear programs in four-year institutions. The method of 
analysis of multiple c^ounting outlined in the recommendations 
.chapter of this report gives ^ procedure that can be used to 
determine Which or what part of these two, reporti^ should be use,d 
in a particular state. . 

To review, this section has presented an overview and spe-- 
cific details of the problem of multiple counting that occurs 
because an individual i^ included in two repot-ts.^ The overlap 
^in reporting between VEDS, CETA, RSA, and HEGIS is discussed and 
findings re&ulting from state studies were presented. Specific 
procedures for eliminating multiple counting are presented in 
chapter 4. 

Under counting " - 

Supply estimates showing individuals trained and available 
for employment may be underestimated by failure to secure data 
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or by receipt-' of only partial data from all traxmng entities • 
If significant numbers of people are being trained and not coun- 
ted the reported supply could create a false picttire of training 
needs. For valid decisions about training programs it is es- 
sential that the data that form the basis for, those decisions be 
as complete as possible. 

In the 'states included in the study thete^are several in- 
stances where parts of the supply data may not be readily avail- 
able. In several states proprietary schools train relatively , 
large numbers of students who are not reported through ajiy state 
system. Some public schools, at both the secondary and postsec- 
ondary lelvels, are training individuals for jobsMWho are not re- 
ported through any system. Training done by CBO^ usually is 
not reported unless through the*' agency supporting the trainee. 
These three potentictl^^^^causes of ^ undercounting are discussed in 
more detail dn the remainder of this section. 

Proprietary Schools . » ^ 

Most of the^persons interviewed in^ the states felt that the 
largest number of people being trained but not included in any ^ 
state reporting system occured in the proprietary schools • 
Numbers mentioned by states ranged from a few hundred to oyer 
sixty thousand -enrolled in these institutions. Two of the 
states in the study have no regulations gdverning. proprieta^ry 
schools. The remainder of the states have regulatory agencies-^, 
for proprietary schools but do not collect data by occupation. 
Of the^en states studied; six do not -use proprietary data in 
calculating supply whereas three use^the Noncollegiate Post- : ' 
secondary Survey (NCPS) data. Some proprie-tary schools are very 
resistant to any regulation according to some og the individuals 
interviewed. 

The one instance in which proprietary s^chool reporting 
seems to be fairly consistent is in the reports made to the Vet- 
erans Administration. This is of course, promptediby the re- 
quirements of the VA fd'r follow-up data for those OTograms. 
training veterans. This reporting requirement affe^^as many as 
50 percent of the program^ in some proprietary schools. If the 
VA reduces its follow-up requirements this source of ^ata will 
cease to exist. ^ f 

There are several alternative approaches that mi^ht prove 
effective in getting supply data from proprietary schools. The 
Noncollegiate Postsecondary Survey (NCPS) condrfcted by the Na-' ^ 
ti/onal^Center for . Education Statistics (NCES) collects data from 
proprietary schools. A sh<^t form is sent to all of the schools 
for which addresses are available. A 10 percent survey^based on 
a national sample Collects additional information* Both forms 
provide enrollment and completion data by program, however, no 
•follow-up data are collected. NCES uses SOICC to update the 



school list and encourages them to mail the questionnaires. 
SOICCs can have long forms sent to all schools by paying the ad- 
(|itional mailing cost. 

Several* states have conducted surveys to collect completion 
da-lia from proprietary schools. Most proprietary^ school opera- 
tors indicated a willingne^ss to provide this information to a. 
responsible state agency siich as SOICC. In a few instances pro- 
prietary school r-epresentatives refused an interview with the 
project team indicating that they would not provide any informa- 
tion regarding their operation. Some proprietary represeoita- 
tives took the position that since they were not operating on 
public funds they were under no obligation to base program deci- 
sions on supgly/demand information. Other schools t-ook the po- 
sition that supply/demand data would be effectively used in de^ 
cisions relating to program offerings. 

At least one proprietary school studied, publishes a list 
of completers by program which co^ild be included in calculating 
the pool^ of trained workers for' the occupations involved. In- 
terviewees in several states indicated that in their opinion a 
law was needed which requires proprietary schools to report 
enrollment, completions, and placement by occupation (progreon) 
to some designated state agency. 

Undercounting^ in Public Schools 

Another instance of possible undercounting is in programs 
in the public schools which are producing people available for 
placement in a specific occupation but not reported throiigh any 
system. Opinions as to the importance of this possibility were 
widely varied within the states studied^ Generally it was felt 
by many state leaders that there were significant numbers being 
trained at the local level that were not being reported. On the 
other hand. most of those at the local level stated that aLl in- 
dividuals receiving occupational ly specific skill training ^were 
being reported. Instances were mentioned where a few individ- 
uals from non-reported programs might be considered prepared for 
a specific occupation but numbers v/ere so low as to be unimport- 
ant to total supply. ^^-^ 

Secondary level . In secondary education dtie state reports 
only oft those programs receiving federal vocational funds while 
in the other nine states programs receiving state or federal 
funds are reported, ^n the state reporting onlv^.^f^deralIy 
funded programs only one small secondary schoolr vas eliminated 
from the list of vocational programs. In a ste^e using this 
reporting policy those calculating <7supply/demand should care- 
fully investigate the number of .vocational programs not being 
reported. In states requiring reporting for both state and 
federally funded programs the undercounting of vocational pro- 
gram trainees should not be a problem; * ' 
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/-Some industrial arts or business programs d^. have students 
who go into a related occupation. Occurrence of this is limited 
in numbers and. sporadic except in a few isolated instances. 
State investigations of this practice have generally not found 
significant numbers consistently bging placed in jobs related to 
training. 

Postsfecondary level . At the postseeondary level in the^ 
states studied no appreciable number of trainees ar^e identified- 
that were not being reported.- Generally, administrators of com- 
munity colleges and technical institutes stated that all pro- 
, grams preparing^, new worTcers were being reported . Many schools 
providing short-term, single-^^iH training are not- reporting 
those programs; 'however, it^s felt that new workers available 
.for femployment were not coming from these programs.. CalcuTators 
of supply/demand should be cautioned that in some states a ' 
strong resistance to reporting to tl^e State Board for Vocational 
Education has resulted in no VEDS report Of an]? postsecondary 
training. The HISGIS report on degrees and other formal awards 
conferred .might serve as an acceptable alternative in some 
states. Only full investigation of the situation in a specific 
state can determine where significant undercountlng nfay bp oc- 
curring ^ * - ^ 

This section discusses situations in which persons may be 
prepared for and entering the work force but not reported 
thrpugh any system. Recomiaendations on how best to account for 
these omissions are contained in the following chapter. 

Other findings which affect the improvement and use of 
supply/demand data are discussed in the remainder of this chap- • 
ter • 

• • ^ * ■ . 

' Description of State Reporting Systems 

The State Occupational Information Coordinating Committees 
have tke responsibility to coordinate the necessary resources to 
develop and implement an occupational information system (Appen- 
dix B). The states included in this study have developed dif- 
' ferent^ operational alternatives to satisfy this charge. Four of 
the SOICCs vi-sltfed- are now producing a labor supply/demand re- 
port, three of these are contra^cting with another agency for^the 
report, another four SOICCs are in the development stage of pro- 
glueing the first supply/demand report for their state, and twO'r 
other SOICCs are establishing a network of interrelated agency 
data systems. 
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All eight of the states inv which a labor supply report 'i^s 
produced or planned stated thatyVCETA data and VElBS *data are in- 
cluded in the reports. » Only twb;Of t^^e'SOICC's indicated that 
they only include the CETA data\%h clients not reported by voca- 
tioj^^. education. Eighty-eight percent of the reports include^ 
HEG^jpPata and ^ 5 .percent include^;jSfCPS data. In only one in- 
stance was an expanded NCPS survey\used to secure more indepth 
vdata from proprietary schools. Fifty percent of the reports in- 
clude RSA and Job Corps , data, 38 percent included SNAPS «and* 25 * 
percent included defense data. Only two states report^^that all 
eight data bases are used or being considered to be used in 'pro- 
ducing tlieir labor supply report. ^ 

In order to. better understand the reports that are being 
used each of * thpmajor data sources and how data are colXeqted . 
will be discua|ted. 

Vocational Education Data System (Secondary) ' . ^ 

Three states reported that they are collecting data only to 
complete the VEDS report, no additional student data is collect- 
ed. All states reported that they would be including individual 
CETA clients in the VEDS report. Two -states reported receiving 
a MIS report from CETA indicating the number of^CETA clients 
trained by vocational education. Two states reported that 
vocational education would not be including* contracted CETA 
classes in the VEDS report. None of the vocational education 
respondents indicated they could identify individual vocational 
rehabilitation clients. Most states indicated thei^e instances 
of duplicate counting would be negligible because of- small 
numbers and the fact that eight of the ten states do pot use RSA 
data in estimating supply. 

States reported using various nfethods to ayoid duplicate 
c&unting on the VEDS report. Methods included identification of 
each student by social security number or student number, using 
a fiscal auditing method, and avoiding multiple counting by 
staff instruction and training. Two states reported that they-, 
had no formal system to avoid duplicate counting in the V^]p)S re- 
port (figure 3.2). . • . 

The secondary vocational education data flow chart repre- 
sents the various ways that data flowed in the ten states visit- 
ed (figure 3.3). States mail information forms and instructions 
from the state MIS to the local schools to be filled out. Other 
systems collect information on 'students at the loG2tl level and 
send this information in individual or aggregrate^ form to the 
gtate MIS. • 
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Figure 3.2 

Individual State Vocational Education Reporting Systems 
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Figure 3.2 Continued 
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Figure 3 .3 Secondary Vocational » Data JPlow 



The local school aissigns someone the responsibility of col*^ 
lecting thte data (Figure 3.4) • In some ca$es the student fills 
out the record and this is placed directly on-line* VTl^is allows 
both the regional and state offices to have access to the data 
at the same time. In the instance where an area vocational 
school is involved; data on each students is returned to the 
principal at the student's home high school. It should be 
stated again that data can be individual student, class , pro- 
gram, school, district, regional based, or aggregated at each 
level depending on the system used. 
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Figure 3.4 'Local Secondary Vocational Data Flow 



Once the data reach the state level they are often checked 
by sending them to each state program specialist or back to the 
local person if there are unanswered question about the data. 
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At the state level r data are received either in individual or 
aggregated form, duplicated or unduplicated, and methods for 
completing the federal reports are based on each state's system 
fpr aggregating unduplicated data. 

Postsecondary Vocational Education Data Systems (VEDS/HEGIS ) 

Staff observations in the field found postseGondary voca- 
tional . education data flow to be much less complicated than the 
secondary vocational education data flow (Figure 3.5). 
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Figure 3.5 VEDS Postsecondary Data Flow 



Data could be collected by anyone given that responsibility'^but 
in most cases the postsecondary institution had a person in 
charge of MIS or research who is responsible for data collection 
and reporting. Most states included in the study havaya separ- 
ate reporting system for the VEDS and HEGIS data. Only one 
^tate reported a system where the data is reported on one form 
and the VEDS and HEGIS are pulled from it. 



Most states report an automated system for the VEDS data- 
Most postsecondary institutions place data on computers at the 
institution. The tapes are then sent to the state MIS or it has 
been placed directly on-line at the institution. 

Vocational Data Systems (Postsecondary) 

The HEGIS report in all but one state is a separate report; 
All but two states report that different agencies in the state 
have the responsibility for HEGIS and VEDS. No stepa are taken 
"within the states to unduplicate these two reports. 



HEGIS data in most instances are collected manually. These 

data are generally the responsibility of a Board of Higher Edtf-^ 

cation. The HEGIS forms are usually mailed -from the Board of. 

Higher Education to the person responsible for the data at each 

institution. The form's are filled out and returned to the Board 
or sent directly to- NCES (Figure 3.6). • 

h 
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Figure 3.6 Postsecondary Data Flow 

Most labor supply reports contain data from'VEDS and HEGIS. 
This represents a large double count of trained workers unless 
some system is used to unduplicate. Exceptions did occur/ one 
labor supply report only contained VEDS and another used only 
the-' secondary VEDS data, and the HEGIS/ but in most cases multi- 
ple counting 'is ^happening. 



CETA Data Reporting System 



CETA contracts £or training through many different agen- 
cies. In most instances the major portion of training is done 
by vocational education (Figure 3.7). Only two agencies re- 
ported that they identify these students and send a report to 
vocational education monthly. In most states / both the VEDS and 
CETA report is used to produce the labor supply report. This 
represents in mdst states a large double count. Most CETA 
agencies can identify the. students but do not have the data sys- 
tem presently designed .to be able to access this information. 

Data are sent by the contractors by program in aggregated 
form, to. the prime sponsor MIS, but individual records on ^par- 
ticipants is the method most, widely used by CETA agencies inter- 
viewed. The majority of the agencies have computer based sys- 
tems for record keeping (Figure 3.8) • ^ 
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The following chart shows the data reported by the CETA agencies visited in each state. 
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Figures.? 

Estimate of Training Provided by Agencies to CETA Participants 
Data System Designed to Identify Providers 
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Figure 3.7, continued 
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Pi'gure 3.8, ceta Data Flow 
• Summary of Perceptions of Reporting Svst^n. • 
the stl:te':L'°S:|i'?^i!^ responses of Individuals at 

:o^ ^.j^^^^^"^^"^ rSt-aaT 

and because ^f ^Su^d^lg': ^ interviewee is posslbre 

• . , Table 3.2 



Percent Indicating. Responsibility for Reporting Data on 

Individuals Trained 



Training 
Agencies 



Teach/Couns. Stdnts. Adminis. Clerical Other 




15 
13 



3 
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(n=24) 


42 


13 
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,^e . local secondary res^r^^^^^^J^^^j:^.- 
the responsibility for ^porting ^^^^J^^^^'^g and counselors at 
selors. While only 29 Pe-ent ^^^^^^ Jj^^ ^^y . The state 
the post^econdary level had ^^^J^^^J^^^^^ge o£ teachers and 
level staff reported * r^^/°^!\his task! Only a small per- 
^^^n^^^^^o? ^:^^n5:nS"rSi:t^?haf ^tuden.r and clerical staff 
have t.hese responsibilities. *> „ 

' * • ^ flow of data are the 

X other factors having ^-P!^^,°S^^^?of on ?he persons re- 
amount of pressure ar>d the amount °^^^^^^°i3\eported the fol- 
sponsible for the reporting. The respon t~ 

lowing: * • 



Table 3.3 

Percent Indicating Amount P^^^f';^^^ 

complete Reporting 



to do Accurate and 



Training 
Agencies 



Low 



Local P-Sec. 
Local Sec . 
CETA 

State Sec* 
State P-SeC. 
(n = 113) 



20 
21 
11 
13 

15 



4 
4 
4 

0 
0 



12 
17 
14 
17 
8 , 



4 
44 
29 
18 
57 
46 



High 



16 

29 

54 

13 

31 



- ~ " ^ to rate the amount of 

Of the 113 resix^ndents ^^^°;^^^^/^^^pie?e reporting 77 per- 

pressure they felt to do ^^^""^^^^^^^^el f elt hi^ly pressured, 
lent of the state P°s ^ secondary personnel te ^g^^ ^.^^^^ 

and 60 percent of their l^^^^^^^^^^^^^J^ndents also felt high 
ssured. The 7 2 percent of the-_CLiA r^^y^ 
pressure to do accurate reporting. ^ 

At the local secondary level^5B perce^ feU a^lot^of^^ , 
pressure to do complete and -^^^^f J^^^fl^ie! 70 percent" of the 

Lit only kittle pressure., ^^^^^.^^fe^^ured to do accurate re- 
secondary respondents felt nignxy f 

porting. 
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Table 3.4 V 

Percent Indicating Degree -Qf Control Placed on 
<i Local School for Reporting * 
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Eighty-nine percent of CETA respondents feel a high degree 
n^'^A^^^ IS. placed on them to do accurate and complete r^?ort- 

local level, -58>ercent of the postsecondary repre- 
sentatives ,felt more control than the secondary representatives 
at 33 percent to do accurate and complete reporting. A reversal 
of thxs was shown at the state level. Of the state secondary 
representatives interviewed, 63 percent felt that control was 
exerted on them to do accurate and complete reporting and 40 
percent of the state postsecondary personnel interviewed felt 
that same degree of control. 

Table 3.5 

Percent of Administrators and MIS Personnel Indicating 
Degree of Administrators and MIS Influence in Securing Reports 



Admi n i s t r a tor-a 
MIS Pei-sonnel 



Low 

11 

19 



5 
10 



27 

19 « 



30 
29 



High 
27 
24 
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33 
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» hl„y, oercentaqe of training administrators and MIS staff 
feel tha^'^he^ ^n exert a strong influence in getting reports 
from local training institutxpns . V 



Table 3.6 



Fact 



Percent of .Training Agencies Inflicating 
ors influencing Control on Local School Reportxng 



Uaws/Regs. / ^ Funding Persuasion Other 



Training Agencies 



Local 


P-Sec. 


38 


73 


0 27 


0 


Local 


Sec. 


30 


79 




13 


CETA 




18 


32 


0 ■ 


0 


Stafe 


Sec. 


21 ' 


34 


13 


3 




P-Sec. 


11 


44 


19 


0 


State 









A^- local- level, funding is the most prevalent means of 

inaucfng^^c.^o^J\; su.;it reports . ws ana^^^ 

also a factor xn 1°"^ °^„^JP?"g:?t with laws and regula- 

^m^^i^ -s?sSaS^^ve?.— - . 

.f .ra^^- l-raf ^sc^-ef fn- ir f^lfow^nr .J^e ^ 



. ' Table 3.7. . 

Percent Indicating Degree of Automation of MIS 
By Training Agencies 





Training Agencies 


Low 


2 


3 


4 


High 



Local P-Sec. 


12 


8 


12 


31 


35 


Local Sec. 


70 


4 


4 • . 


9 . 


13 


CETA 


21 


7 . 


4 


18 


50 


State Sec. 


0 


13' 


20 


40 , 


27 


State P-Sec. 


21 


0 


21 


21 


36 


Administrators 


33 


9 


6 


20 ' 


30 


MIS 


19 


4 


17 


27 


33 



(n = 1Q6) 



A majority (66 percent) of the local postsecondary inter- 
viewees saw their MIS system as being highly automated, while at 
the local secondary level 70 percent of those interviewed^ stated 
their MIS was ^ operated manual ly. Sixty-eight percent* of the 
CETA respondents rated their MIS systems as highly automated. 
At the state- level secondary representatives (67 percent) and 
postsecondary represr^tatives (57 percent) reported their MIS 
systems to be highly automated. Over 60 percent of the MIS 
staff interviewed felt Ij^eir systems to be highly automated. 
Half the administrators gave their MIS the same rating* 

In visits to the ten states it was learned that, two of 
them had no state regulating agency for proprietary sch^ools . 
Five of the SOICCs used proprietary school ir^formation in calcu- 
lating supply data. 'The most common reason^ cited for not using 
state generated proprietary school information is that it is not' 
occupationaJLly specific. Duplicate counting coul„d occur between 
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CETA or vocational rehabilitation clients and the NCPS surveys. 
NCPS does not identify the funding source of individuals. 

^11 of the RSA visited, except ojie, contract • for all their 
tr-aining. The one RSA that does some of its own training has 
its data on trainees included in the planned SOICC supply re-^ 
port. Other supply data on RSA are reported by the training Ag- 
ency. 

It was determined that duplication of count would be un- 
likely to occur with Job Corps, since it is an instructional 
provider and uses its own training centers. Some persons^in- 
terviewed felt that -Job Corps data should not be includ^ in 
their report because most of the clients return^ to the ^ate 
from which recruited on completion 'of their training • 

Other Findings 

The 300 individuals interviewed at the state and local 
level consisted of the following officials: 

^ State Occupational Information Coordinating 

^Committee Director 

State Vocational Education Director 
State vocational Education MIS, Director 
State Vocational Education Planner 
CETA Balance of State MIS Supervisor 
UEGIS Coordinator ^ 
Director of the Regulating Agency for Propri- 
etary Schools / 
Postsecondary Vocational Ed^^cation Agency Head ^ 
Vocational Rehabilitation 
Head of a Uniop, or Joint Labor Council 

The research team also made trips to two secondary and two 
postsecondary vocational-technical schools or community colleges 
and two CETA prime sponsors conferring with the following indi- 
viduals: 

" Secondary Vocational Education Director 
Secondary MIS person 

Postsecondary Vocational Education Director 
Postsecondary Vocational Education MIS person 
J A major employer 

A CETA Prime Sponsor Training Director 
A CETA MIS person 

Perceptions of Further Improvements in the OIS 

Information generated by these interv^^s is analyzed and 
discussed earlier in, this chapter. In addition to this infor- 
mation each of the persons interviewed- was asked to state their 
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perception of further improvements which are needed ' to "increase 
the ef f ectiveness/6r ef f iciejncy of the data^ system ih the state. 
The needs observed) by the research teams will be discussed later 
in this chapter and are not necessarily the same as those iden- 
tified by those individuals interviewed. Obviously, if respon- 
sible individuals see areas of improvement (real or imagined) in 
the state data system, this requires some action on the part of 
those responsible. The improvements identified by state and 
local personnel are summarized Ir^elow. Responses were- grouped 
into five categories and the number of sta.tes (out of ten) in 
which this need was mentioned is listed. 

Needed Improvements Relating to Quality of Data: 

o Timeliness of the supply/demand data - 7 states . 

o Data do not show local ^upply /demand - 6 states^ 

o Identification of special ' needs students in VEDS 

report - 2 states . • 

o LxDcal influence on data reported - 1 state., 

o Compliance only reason for reporting - 1 state, 

o Differences in data collection methods - 1 state. \ 

Needed Improvements Relating to Procedures: 

- * o Lack of uniform reporting definitions between 

local, state, federal - 9 states, 
o Lack of coding and s'Vstem uniformity between 
" reporting systems - 9 states. 

o Lack of communication and cooperation between, state 

agencies 8 states, 
o Unrealistic reporting requirements - 5 states, 
o Oianging reporting requirements from year to year 

- 4 states. ^ 
o Mobility of students - 3 states . 

o Lack of automation at local and ^tate level - 3 

states . ■> . - 

o Lack of feedback to local school from state agen- 
ci'es - 2 states. 

o Duplication ot reporting requirements between^ 
reporting systems - 2 states . 

o Lack of use of data by decision makers - 2 states,'. 

Needed Improvements associated with. staff: , ^ 

> ■ •' . 

o Attitude, commitment, awareness of data by data 

reporters and users - 7 state^^ 
Q Local staff lack knowledge of procedures for 

reporting - 3 states, 
o Staff turnover and shortages - 31 states. 



Multiple Counting, UndercOunting, General: 

o Training not reported - 7 states. 

o Student reported through -two systems — 3 states. 

o Sources of supply not included in system - 3 states. 

o Privacy rights and laws - 2 states. 

Th% improvements that providers and users of state arid lo- 
cal data systems see as most important seem to fall into three 
general areas of need: 

o Need for improving quality of the data in terms of 
timelineers, local usefulness, and eliminating multi- 
ple counting and under counting 

o Need for uniformity in definitions, coding^ and 
procedures 

o Need for greater commitment and cooperation in im- 
proving the quality and use of data 

Although some of the improvements identified by the 
indivifluals interviewed appear to be highly individualized and/ 
or localized, the suggeistions that were most commonly mentioned 
must be taken as indicative of a 'need. * Whereas the study being 
reported here deals only with supply data from the sources 
identified, full utilization of information for effective 
planning is equally dependent upon the other factors mentioned 
as major problems. The following section of this chapter is a 
report of the major needs observed by the project teams visiting 
the states . . 

Needs Observed 

individuals conducting the research on improving the supply 
data that go into the occupational supply/demand systei?i spent 
two weeks each in ^en states. In addition to the interviews 
mentioned earlier, the investigation included, the collection 
and review of da^ta collection forms, completed forms, summax^za- 
tions, and reports and observations in local schools and CETA 
Prime Sponsors. Team members were able to visualize the overall 
data system in the state, its individual components, the*^^ 
methodology and procedures used, and to get a "feel" for the 
setting in which the system operates. 

Based on these observations and the individual interviews 
the team has identified the fallowing areas for improvement: 
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. o Inability to secure data on the output of proprie- 
tary, schools and other cases of undercounting^and 
multiple counting 

o A lack of commitment to the use and improvement 
of the data system 

o A lack of cooperation and communication within and 

between agencies and local schools Or agencies ^ 

o A lack of uniform, clearly understood definitions 
and codes ' ^ 

The needs identified by the research team are not greatly 
different from those most often mentioned by the interviewees. 
Und^rcounting and multiple counting were widely recognized as 
concerns by those calculating supply numbers. The need for 
commitment to the collection and use of data and cooperation'^ 
between agencies in this effort was also (^served and stressed 
by interviewees. Uniformity of coding and*^ definitions was a 
need identified through both observation and interviewing. 

The Human Factor in Data-based" Decision Making 

As this research work in the states progressed it became 
increasingly obvious that undercounting and multip]^e counting 
are indeed critical issues that must be resolved; but the staff ^ 
also realized that these problems could only be resolved in 
terms of the context in which the system operates. The team was 
struck by the almost univerjal skepticism about the quality of 
the data and the equally compelling and pervasive feeling of 
need for accurate, timely, and relevanjt information upon which 
to base^ecisions . 



As complex as the counting problem is the researchers in 
the; field were constantly nagged by a more generic and fundamen- 
tal pr^oblem — the milieu in which data systems operate and deci- 
sions are made. This system is made up of a number of independ- 
ent training operations each with its own MIS and d^ision 
making procedures. The ultimate ob jective-that of improving the 
quality and use of the odcupational supply/demand information 
system — pan only be fully achieved when all parts of t1ie process 
mesh to produce information that improves decisions. In this ' 
section the research staff will attempt to set in some perspec- 
tive the environment In the states as it was observed and to 
relate some recent writings in information theory to those state 
situations^. . ^ 

The need for relevant information that can be used in 
making decisions pertaining to occupational training is increas- 
fi' . ingly being recognized by state^ Leader s . This development is 
triggered by (1) the rapid turnover of state leadership, which 
reduces the experience base, (2) the multiplicity and complexity 
of the decisions to be made^ (3) the. demand for accountability 
(4) the many special groups with special oe^ds, (5)^the move 
toward individualism,^ and many other factors. 
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Society's perception pt leadership an4 perhaps state train- 
ing leadership's self-perception, is gradually changing from 
that of the leader \ft*io "shoots from the hipr" "flies by the s6at 
of his pants," ajid gives instant decis-ions to a decision maker 
relying heavily on relevant data. Hie effective leader is no 
•longer perceived as a person expected to know everything but one 
who IS able to balance the complex forces' that impact on effec- 
tive administration of programs. As in any such transition 
there will be in^^ividuals at all stages of change, from those 
still very doubtful of the data to those totally enamored with 
it. " ' 

• A9 the .use of data becomes more and more closely associated 
wit'h intelligent decisions, there is a danger of those just dis- 
covering its usefulness becoming totally dependent upon and re- 
active to masses of data — any data. And so, we find decision 
makers gathering information they do not use, asking for^reports 
they. do not read, and acting, and then requesting in format ion - to - 
justify the act (Feldman and March, June 1981). 

This image of information utilisjation contrasts dramatically 
with the view that information gathered .for use in decision mak-: 
ing will be used in making that decision and available informa- 
tion will be examined before .moire information is requested and 
gathered. However, to be realistic, it must be recognized that 
as the intelligent use of data for rJecisions becomes increasing- 
ly the symbol of effective^ leadership, some administrators will 
manage to assume the form, without beitfg influenced by the 
..substance. 

' This appearance of data utilization may resul"t from many 
,causes--objective decisions are not really wanted? managers do 
not know how to use data; politics, special interests or tradi- 
tion are stronger; or there is a fear of losing' decision making 
power. On the other hand, data are expensive to gather and ana- 
lyze, data are often isospected of being inaccurate or manipulat- 
ed, and problems may arise^that were not^ anticipated. Yet. or- 
ganizations somehow survive and even succeed. Individuals de- 
velop rules for dealing with information under conditions of 
conflict. Decision makers discount much of the information that 
is generated. Not al 1 '^information is ignored, however, and in- 
ferences are made (National Academy of Sciences 1979). 

r 

Just as in the change 'process, information seems to deve-, 
lop a force of its. own. As the belief increases that more in- 
formation characterizes better decisions so does the mass of 
information available become transformed, through practice, into 
functional necessity^ 



Environment for Information Generation and Use 



Project staff spent two weeks in each of ten states inter- 
viewing providers, collectors and users=> of occupational supply 
data. The staff gradually began tr) realize that, as in all hu- 
man endeavors, there was much more operating than^the straight 
forward recording, analysis, and use of data. Human egos, 
fears, biases were involved. Turf ism, tradition, politics, and 
vested interest were matched against a strong committment to co- 
operative solution of the states training needs. The whole gam- 
ut of human emotions were found to be affecting this process. 
This finding should not be surprising since humans are involved 
in every step Of the accounting of individuals trained and . . 
available- for work. 

This recording of the fact that the process is influenced 
by human feeling^ and behavior should not be taken as a criti- j 
cism of the system. Rather it should alay the fears- of loss of 
individualism--*'treating everyone as a number"--and emphasise 
the fact that the driving forcTe behind the whole effort is to be 
better able to serve all individuals. This operation should , 
therefore, be viewed as a social process involving students, 
teachers, administrators, secretaries, computer operators, etc. 
It is not simply a problem of forms, computers, and reports. 
Administrators may have a much better grasp of this concept than 
do MIS people whose observable problems are usually more mechan- 
ical. The understanding that this is a people problem - -people 
' must fill in the forms, people must punch the buttons, people 

must take" the jobs, people must make the decisions--as this is 
recognized our search for solutions becomes sharpened. The 
construction of forms, the processing of data are important but 
only as a means of making people better informed and helping 
them make better decisions. 

The "push-pull" situation, found to some extent in all 
states, further illustrates the humanness and consequently the 
complexity of the problem. Interview notes are replete with 
these push-pull illustrations: 

^If the data were better we would use them more" 

"If the data were used more we could make them better" 

"We already have more data than are used" 
"There are never enough data" 

"Those people who gather the data" 
"Those people who use the data" 

"The data have very few errors" 

"The data are not reliable" E| . 

" f o 

"Local employers can give us better information" 
"Local employers do not care i f we train too many" 

41 ' , 
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"Those people at the state office" t 
"Those "people at the local school" 
^* 

"That's SOICC's job" 

"That's OUR job?" ' ^ ' 

This section of the report has discussed some issues in ad- 
tJition to under counting and multiple counting that the project 
staff felt to be important. As data collection and analysis 
methods become more sophisticated, so must the use of the infor- 
mation. 

Perceptions of Factors Influencing Quality and Use of - Data 

The information presented^ in this section relates indirect- 
ly to undetcounting and dupl4|fcate counting but is believed to 
impact on the quality of the /data. Data are not created in a 
vacuum. They are developed humans with varying degrees of 
education, training in data collection, and ideas about the 
importance, and use of data. All these affect the accuracy and 
the perceived accuracy of data. These findings are useful in 
' understanding the environment in whi<:h data are collected. All 
numbers given are percentages and may rtot total 100 due to roun- 
dj/rtg. Identification of interviewee groups can be found in Ap- 
pendix; C. 

Table 3.8 

, Perceptions of Degree of Data Accuracy by Interviewees 



Interviewee 
Group 


Inaccurate 


2 


Local Sec. 


0 


9 


Local P-Sec. 


0' 


4 


CETA 


0 


3 


State Sec. 


0 


9 


State P-Sec. 


0 


13 


Administrators 


0 


10 


MIS 


0 


7 


Combined Sec. 


0 


9 


Combined P-Sec 


. 0 


7 
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3 


4 


JT 

Accurate 




V. 


17 


44 


30 ' 


(n 


= 26) 


23 


35 


' 39 


(n 


= 23) 


10 


47 


40 


(n 


= 30) 


41 


41 


9 


(n 


= 32) 


27 


47 


13 


(n 


= 15) 


24 


37 


29 


(n 


= 70) 


29 


46 


18 


(n 


= 56) - 


31 


42 


18 , 


(n 


= 55) 


24 


39 


29 


(n 


= 41) ' 
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Local secondary and pos tsecondary representatives appear to 
have more confidence in the accuracy of their data than state 
staff have. Both secondary and pos tsecondary rated their data 
accuracy high; 73 percent and 74 percent respectively! Fev/e/ 
state level secondary and postsecondary personnel con^^^ 
dence in data accuracy, 50 percent and 60 percent respectively 
rating it, as highly accurate. CETA also rated their data quite 
accurate, giving accurate (4-5) an 87 percent rati^fg. Nearly 
two-thirds of the administrators (66 percent) and MIS manageris 
(64 percent) felt that their data were reasonably accurate. 

?. 

Table 3.9 

Level of Data Collection Priority by Interviewee Group' 



Interviewee Group 


Low 


2 


3 


4 


High 






Local Sec. 


4 


21 


29 


25 


21 


(n 


= 24) 


Local P-Sec. 


0 


4 


19 


35 


42 


(n 


= 26) 


CETA 


3 


0 


13 


42 


42 


(n 


= 31) 


State Sec. 


0 


13 


22 


52 


13 


(n 




State P-Sec. ^ 


0 


0 


t 


38 


31 


(n 


= 16) 


Combined Sec. 


2 


17 




38 


17 


(n 


= 47) 


Combined P-Sec. 


0 


2 


24 


36 


38 


(n 


= 42) 



By comparing overall responses, CETA gave the highest pri- 
ority to data collection; 84 percent of CETA respondents rated 
it very high. Twenty-four percent of the postsecondary respon- 
dents felt data collection was a high priority as compared to 55 
percent of the secondary > respondents . 
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Table 3,10 



Percent indicating Program Funding Based on Data Submitted 
. by Interviewee Group 



Interviewee Group . 


YES 


NO 




— {~ 

Local Sec. 1 


— — — - 
- 67 


17 


(n = 2) ' 


Local P-^SecV. 


100 


u 




CETA 


75 


• 25 


(n - 16) 


State Sec. 




15 


(n = 13) 


State P-Sec. 


80 


^ 20 


(n = 10) 


Administrators 


82 


18 


(n ^ 22) 


MIS 


77^ 


18 


(n'= 17) 


Combined Sed. 


79 


16 


(n = 19) 


Combined P-Sec. 


83 


17 


(n = 12) 


: c::^ 



Funding for secondary and postsecondary vocational educa- 
tion program is influenced substantially by the data received 
from the local level. All local postsecondary representatives 
stated their vocational programs received funding on the basis 
or the data they submitted. At the state level, 80 percent of 
those interviewed said they funded programs based on data 
submitted. , • 



Table 3.11 



Percent Indicating 


Reports Sent to 


Local 


Agencies 


• By' Interviewee Group 






Interviewee Group ^ 


Yes 


No 




CETA 


84 


16 


(n = 19) 


State Secondary 


100 


0 


(n = 26) 


State Postsecondary 


71 


29 


(n = 14) 


Administrators 


72 


21 


(n = 29) 


MIS 


88 


9 


(n = 32) ' 
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Respondents were asked if completed reports v/ere returned 
to local agencies • The majority of respondents indicated that 
they, sent reports to local agencies. 

Tabl^ 3.12 i 
Purpose of MIS Reports (Percent) 



Interviewee 
Group 


Plan. 


Fund . 


Prog. 
Wee . 


Rpting 


Needs 
Assess . 


Eval . 


Other n 


Local P-Sec. 


85 




58 


« ^ 

96 ' 


23 


27 


46 (38) 


iocal Sec. 


83 


54 


71 


79 


33 . 


38 


29 (32) 


CETA 


' 83 


52 


52 


94 


19 


45 


. 32 (v49 ) 


State Sec. 


91 


50 


25 


66 


. 13 


34 


22 (43^ 


State P-Sec. 


73 - 


75 


56 


63 


44 


31 


31 (46) 


Administrators 


86 


49 


52 


71 


20 


34 


43 (54) 


MISh^ 


7(S 


51 


■ 40 


68 


26 


28 


23 (48) 



Both secondary and post secondary state ageYicies report that 
the major use of MIS data is mainly for planning. At the state 
postsecondary level 7 5 percent of those interviewed indicated 
the data are ^used for /funding decisions. Over half (»63 percent) 
of state postsecondary respondents iridicated -using MIS data for 
reporting purposes and (56 percent ) reported use of MIS reports 
in making program decisions. 

Local postsecondary represerttatives indicated the MIS re- 
port's used for reporting, planning, funding, and progrcon deci- 
s ions . Local secondary representatives used MIS reports for 
planning (83 percent); reporting (79 percent); and program deci- 
sions (71 percent). CETA*s use of reports was for reporting (94 
percent) and planning (8 3 percent). 

When administrators and f^IS managers were -asked for what 
purposes MIS reports. were used, eight out of ten identified 
planning ; seven out of ten ic^entif ied general reporting ; nearly 
half' identified funding and program decisions; and less than 
one-third identified using reports for evaluation and needs as- 
s^essment. . ^ 

* 
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Review # 

'This chapter has presented findings of this study of supply 
data in the following areas: . \ 

o Problems and causes of multiple counting and under- 
counting 

o A description of state reporting systems and indi- 
vidual perceptions relating to those systems 

o Interviewee and project team members perceptions of 
problems in tine reporting system „ 

o A discussion of the human factors and^ the . environ- 
ment in decising making 

O A/'jpresentation of characteristics of MIS staff's 
and individual views of the factors affectxng the 
quality and use of data ^ ' ( 

' The following V^pter presents conclusions and recommenda- 
tions emerging from/fthe findings; A method 'of analyzing multi- 
ple counting problems is suggested and illustrated. 
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CHAPTER IV 



SUMMARY, CONCLUSIONS, AND RECOMMENDATIONSn 
Introductii^i^ gi^ 

This research project was designed tQ ''identify way-s to im- 
prove the supply side of the occupational supply/deniand data 
system being developed in the states. This data systi§tn will be 
the ma jor source of information used to determine the* Jieed for 
training by specific job title* Use of the supply/demand data 
Will be primarily for program planning (expansion, continuation 
or termination) , . for counseling, and for progr;ain evaluation.- 



The study combined the following: 

o A review of' the relevant li'terature including* 
research reports^ l^aws, regulations , and forms 
relating to the federal and state reporl^ing 
systems , * ^ - 

o Interviews with 274 individuals involved in 
the production and use of data at the state 
or local level in ten states 

o' Interviews and conferences with agency repre- 
sentatives at the state and federal level and 

o Observations in ten states and sixty local ^ 
training institutions or agencieiJ^ 

Conclusions 
^ ' — 

Based on information produced through the steps outlined 
previously the project staff present the following. conclusions 
for this study: 

o Duplicate reporting of traifiees does occur - 

. in numbers large enough^ to significantly 
. J influence supply data and decisions made on 
• that data. CETA reportrs arid VEDS reports^ 
both contain names of CETA trainees irl re- 
gular vocational classes at both thOt second- 
ary and postsecondary Jfevels. • SivkGe neither 
party should be expected to reduce the num- 
bers reported this becomes a state problem 
^ and can best be h^andled at that level. The 

VEDS report and the HEGIS report duplicate 
counts of postsecondary vocational students ^ 
receiving a certificate or diploma. Plans to 
implement a uniform reporting base in NCES 
should help to correct this problem. 
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Vocational education is the major provider of train- 
ing for CETA clients in. most states apd for most 
prime sponsors. In a few instances CETA places signi- 
ficant ' numbers of its clients in proprietary schools 
or CBOs for training. 

Vocational educators take the.pdsition that some 
vocational funds are us'ed in the training of CETA 
clients (building, equipment, and so forth. ) there- 
fore, they, should be included in the VEDS report* 
No state was found that eliminated CETA clients in 
regular vocational programs from the VEDS report* 
VEDS reporting instructions ask for counts of stu- 
dents in programs supported by vocational funds 
(state plan programs) and in no instance do' the 
instructions require the elimination of students 
supported by other funds. 

The development of an effective occupational supply/ 
demand dataVsystem requires several years. The ef- 
fective useVf such a system may take even longer. 

Generally states require VEDS reports on any program 
receiving federal or state funds. This means that 
every appfoved vocational program is included in the 
state plan/and the VEDS report, whether or not it 
receiv«-&^ny federal vocational funds . 

If a state requires the VEDS report on only federal- 
ly supported vocational programs, a school may (1) re 
fuse the federal funds and not report on any programs 
or, (2) designate only certain programs as receiving 
federal vocational funds and report on only those. On 
.one state in the ten studied had this situation. 

Proprietary schools are a major source of trained 
workers, which are not included in many of the 
state's supply/demand data systems. 

Training occurring An most secondary programs not 
traditionally considered to be vocational (indus- 
trial arts, typing, bookkeeping, and so forth^ 
generally, do not produce students available for a 
specific occupation in numbers great enough to be 
significant. 

*» , 
Community colleges have a large number of students 
who only take one or a few coupses needed for em- 
ployment. Those compiling supply data should ini- 
tiate procedures to include these individuals if 
they aire prepared for a specific occupation or occu- 
pational group. 

« 
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o Reporting systems, to be most effective in providing 
supply data, should be occupationdl ly specific, use 
a unique individual number such as social security 
number, show numbers of completers available for a 
job, and report numbers placed by job title. 

Recommendations 

Improvement of Supply Data 

1. Supply numbers should be based on number of 
trainees available for employment s If, this 
information is not available ^ome logical 
modification formula should be applied to 
other available data. 

2. A major cause of undercounting is lack of data 
on proprietary schools* A state may (1) conduct 
survey of proprietary schools , ( 2 ) secure NCPS 
data from NCES, and/oir (3) encourage state laws 
to require reporting of proprietary schools. 

It is recommended that SOICCs do the mailing 
of the Noncollegiate Postsecondary Survey, re- 
ceive the responses back from schools, record 
completion data, and send material on to NCES. 

3. Based on state differences major supply d^ta 
sources should be as follows: 



VEDS - Secondary and Postsecondary 
CETA - Contracted Classes (if not reported in 
VEQS) 

•Propr iqjbary Schools data - NCPS 

Supplemental sources that should be considered 
are as follows: 

HEGIS - 2-year programs in 4-year 

institutions ' 

CBO - in instances where numbers are 
significant 

■ <i . 

4. CETA reports should be modified to include the 
type of institution providing the training and 
whether on an individual referral or contracted 
class basis. 

5* Every effort should be made to use sociaU'security 
numbers to identify every individual receiving 
training in any federal or state funded program. 
This would facilitate the process of correcting 
-^duplicate counting. 
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6. Numbers of trainees missed through vocational pro- 
grams that do not fill out federal reports, although 
not significant in most states, should be studied 

by the state agency responsible for calculating 
supply. 

> ■ ■ ■ ' 

7. Secondary programs not usually considered voca- 
tional (industrial arts, typing, and so forth) 
should be investigated to determine if they 
constitute a significant source of trainees not 

"being reported. > ^ 

Impyoveinent of Supply/Demand System 

\, At the Federal level e^ery effort should be exerted 
to establish one occupational coding sys tem and one 
* . education-training program coding system . The NCES 
uniform reporting system is designed to partically 
elimnate this problem when implemented. 

2. States should establish a policy of occupational 
training program approval or continuation based on 
occupational demand, student interest, acceptable 
placement levels, and other factors identified 
within the state. 

3. As stated in the creating legislation the SOICC 
Committee should have principle responsibility 
for the production of a report which matches 

• occupational supply against occupational demand. 

4. The Occupational Employment Statistic (OES) program 
should continue to be expanded in order to provide 
occupational demand information in the states. 

5. Of ficials at the state and federal levels should . 
continue to investigate alternative ways of securing 
follow-up information. These might include sampling- 
or use of existing data such as Unemployment Insur- 
ance, Internal Reveniie, Social Security, or others. 

6. State procedures should be established to ensure 
involvement of, and feedback to, local ^providers of 
data. " ■ . ' 

7.0 Research should be conducted to identify ways to 

increase the use of supply /demand data' in- state and 
agency program planning. 
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Analysis of Multiple Counting " \^ 

It is recommended that the following s'eries of questions be 
used to eliminate, duplicate counting in Supply calculations^ 
•Any agency faced with using training "reports to calculate supply 
where duplicate report iTig is suspected can work through these ^ 
questions to reach a solution to the .p^roblem. An example Qf the 
use of the proces^ i,s giver^ a't the end of this section. 

' ^ • i 

» In . case of a traine'e or program supported--t^ f under other 
than the trainer the following questions should be considered:. 

Q. 1. Does the report from the f under and the report 

from tlie trainer both report ' individuals trained 
by specific occupation -^or occupational group? 



Q. 2\ What is the magnitude of this duplicate count- 
ing? 



Q. 3. Can the trainer identify students^ supported 
(reported) by the, f under? 



4, Can the f under identify in its report, students 
reported by the trainer? y 

Q. 5. What will be lost by not using trainers 
reports? . 

Q. 6. Can this loss be co^rrected in any otheiS way? 
7. What will be lost by not • using *f under re^'^orts? 

» 

Q. 8. Can this loss be corrected in any other yay? 
'^Q. 9. What are the alternative solutions? 
Q.IO. What is the most feasible alternative? 



I Example of analysis of multiple counting. (Vocational 
Education and CETA) 
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Table .4.1 



ANALYSIS OF MULTIPLE COUNTING 



QUESTION 



ALTERNATIVE ANSWERS 



CONCLUSIONS 



Q. 1. Does the re- 
repart from the 
f under (CETA) 
and the report 
from the trainer 
(VEDS) both re- 
port individuals 
trained by speci- 
fic occupation or- 
occupational 
group? 



Q.2. What is 
the magnitude of 
this duplicate 
countincf? 



A.l. Vocational ed- 
ucation (VEDS) re- 
ports CETA individ- 
ual referrals but . 
not classes contract- * 
ed for CETA trainees 
only. 

A. 2. "CETA reports 
all clients placed 
in training, 
A. 3. If either GETA 
or vocational educa- 
tion does not report 
students trained by 
vocational education 
and funded by CETA 
no multiple counting 
i s (occur ring , 
A»4. . Both vocation-' 
al education and 
CETA report by speci- 
fic occupation or 
occupational group . 

A.l. This multiple re- 
porting is large 
enough to affect sup- 
ply data. 

A. 2. .Multiple colinting 
is too. smalls to affect 
supply data. 
A. 3^ Multiple counting 
is only significant in 
certain occupations. 



C.l. Multiple re- 
porting does obcur 
'between VEDS and 
CETA . 

C.2. Ways, miist be 
found to avoid 
duplicate counting 
in supply data. 



C.l. - Multiple re- 
porting involves 
numbers 'large 
enough to affect 
c^lcuiatioms of 
,s uppl y i n^ tho s e 
occupations, fqr 
which CEtA pro- 
vides training • 



ERLC 



Q . 3 . Can the 
trainer (Voc. Ed.) 
identify students 
supported (re- 
ported) by the 
f under (CETA)? 



A.l. At the locaX 
level/ probably yes. 
At the state level 
probably no. 
A. 2-. If both agen- 
cies use social ^ 
security numbers and 
records are computer- 
ized, duplication 
could be eliminated . 
at the state level. 
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C.l. Since voca- 
tional educators 
consider that 
they are* partial- 
ly funding CETA 
t^^aining ( facili- 
ties , equipment, 
and so forth) , , 
they are not ' » 
likely to be will- 
ing, to eliminate 
CETA students from 
their reports . 




ANALYSIS OF MULTIPLE COUNTING 



QUESTION 



Q.4. Can the 
funder (CETA) 
identify in its 
report students 
reported by 
trainer (VocEd)? 



Q.5. What will 
be lost by not 
using trainers 
(Voc. EdO re- 
port? 

Q.6. Can this 
loss be correct- 
ed in any other 
way? 



Q.7. What will 
be lost by not 
using funder (CETA) 
reports? 



Q.8. Can^this 
loss be corrected 
any other way? 



ALTERNATIVE ANSWERS ' 



CONCLUSIONS 



A.l . If CETA can 
report individual 
referrals separately 
from contracted 
classes a large 
amount of the dupli- 
cation can be eli- 
minated 

A.l . Not using VEDS 
would lose all voca- 
tional students. 



A.l. No, for second- 
ary students. Pos- 
sibly through HEGIS ^ 
for postsecondary stu- 
debits. 

A.l. CETA students 
trained Ln contracted 
classes . 

NOTE: Most States in 
the study reported 
that contradted 
classes only make up 
a small proportion of 
students and is de- 
creasing. 



' C.2. The problem 
^'becomes one of un- 
' duplicating re- 
ports rather than ; 
^ reducing numbers 
reported. 

C.l. Use CETA 
report for "numbers, 
of stud'ents in 
contra^cted 
classes rest 
of CETA students ■ ' 
froxa VEDS 



A.l , 



No- 



el . 
ble. 



No£ fecisi- 



C.l. No adequatie 
method of correc- 
tion. 



C.l. A possible 
solution if no 
better alternative 
can be found. 



C.l. Covjnt would 
be reduced by num- 
ber in contracted 
classes-. I ' 
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ANALYSIS OFO MULTIPLE COUNTING 



QUESTION ALTERNATIVE ANSWERS CONCLUSIONS 

q;9. What are A.l. Unduplicate 

alternative solu- 'count by matching, 

tions to elimin- social security num- 

ate multiple bers if available; 

counting. , A. 2.^ Take contract- 

ed class count from 
CETA. All other from 
vocational education. » 
A. 3. Intermediate- 
^ hgency (SOICC) remove 

individual referrals 

from VEDS or CETA if ' • 

* either group can iden- 
tify. ' 
A. 4. Use only VEDS 
report . . 

^ > - 

Analysis of alternatives 1»o eliminate multiple counting be- 
tween other reporting systems pan follow the same procedure as, 
the example above. Some general guidelines based on a majority 
of states studied are given' in the following statements:, 

o A relative small number of individuals , recisive sup- 
port for skill training ^through RSA. ' 

o RSA refers the majority of its clients Who need 
training *to vocational educatioa- 

o Vocational education reports . RSA trainees in VEDS. 

o VEDS will inclyde' most RSA trainees. 

' o Community based, organizations (CBOs) do some 

training of CETA clients. The number receiving • 
occupationally-specif ic skill training is not , 
significant, in most state's supply calculations. 

o- Veterans Administration (VA) supports trainees in' 
both vocational education and ifi proprietary i 
schools'. 

■ f « " ^ ■ . 

o Vocational education reports those VA clients 
* trained in VEDS. 

o VA clients trained in ' proprietary schools would 
have .to come from^, VA or proprietary reports. ' 
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o Duplication 9ccurs between VEDS report and . HEGIS 
repprt. \ ■ 

O HEGIS report contains enrollments and number^ re- 
ceivi^ng cerrf:ificate or diploma. , • 

■ o states are aware of", but only a few have used Non- 
collegiate Postsecondary Survey (NCPS) data. 

•• ? > ■ 

Concluding Statement 

As a concluding statement to this report the project team, 
in retrospect, found a very complex: situation in each state. A 
situation involving many agencies operatin#>at several levels, _ 
dedicated individuals struggling to prioritize the diverse needs 
and dehiands placed upon them, several reporting and planning 
systems largely operating separately, and a SOICC with ^urf 
to protect and no programs to run, and beginning to establish 
an identity and a mission. There is no doubt about the desira- 
bility of coordination of the training effort. With so many 
highly competent and effective individuals operating,, as would- 
be expected, within their own world of endeavor ,• the necessity 
for individuals without boundries— SOICCl--who can build bridges 
between the existing worlds, isy«ritical . Effective coordma- 
tion can start with an informat^c^d system that communicates with 



all of the providers and fundus of training; that grows into an 
organized cooperative program to meet the job preparation ef- 
forts of the state and nation. The highly idealized picture of 
a state and national occupational training prograrti is no more 
than those persons needing and seeking training .have a right to 
'expect. ' - 

The information systems that can spark and guide this co- 
ordinated effort need not be one system; but if the several data 
mechanisms are to foster communication they must speak th'e s-ame 
language. This need for Ainiformity of language, which seems so 
obvious and yet has provdn to be so elusive, requires time, ef- 
fort,- and leadership at all levels — local, state, and , nation- 
al . The achievement, of this commi/nication tool requires con- 
cessions to others, yielding^o^,^.eviously held positions, 
slaughter of some holy cows, and above all a determination to 
eradicate barriers and construct bridges of cooperation. It is 
time to get about the work of a unified determination of needs 
and a coordinated effort to provide. the training to meet those 
needs. ' 
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APPENDIX A 
LITERATURE REVIEW 

Background 

Chronic high unemployment has plagued the United States in 
the last decade. Some research efforts to under'^tand this prob- 
iCTrt^have concentrated oh bhe characteristics and skills of the 
urfeiAployed, and others have examined the job market itself and 
ha^ reveale^^ many unfilled jobs in the presence of high .unem- 
ployment. Many causes are attributed to these seemingly contra- 
dictory phenomena. A major explanation is a laacH of fit between 
the skills possessed^by the workers and the skills desired by 
the employers. There is, all too often, a -severe mismatch be- 
tween the occupational skill level of the unemployed segment of 
the labor force and the available job openings in a specific 
labor market area. Th^s condition, referred to as ''structural 
unemployment," is real and widespread in large portions of the 
labor market. 

Recent years have seen some res'ponse to the problem of 
structural unemployment. In order for training systems to ful- 
fill their responsibility to individuals and satisfy require- 
ihents within the economic system, training institutions , human 
resource planners, policymakers, 'and economists must have cur-/ 
rent, accurate, comprehensive information about future demand ^ 
requirements,, about current supply and jabout future supply. 
Timely and accurate supply ihformation will allow educators, hu- 
man resource planners, counselors, program planners, and policy- 
makers to make more accurate estimates of human resource needs 
and more informed decisions that could do much to ensure more 
efficient use* of hutnan resources and improved economic growth^ 



The elements of occupational supply are outlined in figure 
1. Occupational supply is broken into three categories: (1) 
current supply, (2) entries, and (3) separations. The first cat- 
egory, current supply , consists of all persons employed in an 
occupation plus those unemployed who are both qualified and 
seeking work in that occupation. This category continually ad- 
justs over time by entrants to and exits from the "supply pool." 

The second category, occupational entries , has as its com- 
ponent parts five possible sources of ejjjjry into an occupation. 
These include specific designated entries for specA^c occupa- 
tions. Completers and leavers from other general training pro- 
grams; entries and transfers froij other different occupations; 
reentries and new entrants from outside the labor force; and 
inmi^rants, those workers who are qualified to enter an occupa- 
tion and have moved into a labor-market area from another geo- 
graphic^ area. ^These five cojnponents form the second category of 
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1. CURRENT SUPPLY 



2. Entries 



A. Specific 
training 



B. Other 
training 



C. Other 

occupations 



D. Outside 
the 

labor force 



( 



Immigration 




EMPLOYED 
plus 

UNEMPLOYED 



3. Separations 



A. Other 

occupations 



B. 



Outsidethe 
labor force 
including 
retirements 



C. Deaths 



D. Emigration 



Figure A.I 



Occupational Supply Model 



occupational entries and create a flow into the stock of 
skilled individuals defined as curren.t supply. 

The third category, occupational separations , has four 
parts flowing out from the current supply stock. These parts 
include transfers to other occupations; individuals leaving the 
labor force, including disabilities and retirements 7 deaths; and 
emigration from a labor market area. In summary, the occupa- 
tional supply model is a flow of entrants into' and out 'of the 
current supply stock. The net change in j::urrent supply is en- 
tries minus sepa^rations . Because current supply ^nd the data 
that refleat supply are derived from so many sources, the poten- 
tial for mivscounting , uncjercounting , and multiple counting in 
supply totals is a continuing concern. 

Occupational Supply Information 

Several studies have suggested that available occupational 
supply information lacks coherence and comprehensiveness. The - 
monograph. Occupational Employment Projection for Labor^ Market 
Areas (1980Ti stated that in econometric forecasting and plan- 
ning models little attention has been given to labor supply 
side. A publication , titled Occupational Training Information 
in New England: An Evaluation noted that the provision of oc- 
cupational supply information is considerably less advanced than 
that of ocdbpational demand, information. 

Occupational entries or training sources that flow into 
current supply are only partially useful for occupational supply 
analysis. Data relevant to each of these sources are neither of 
uniform availability nor quality. In many cases the data are 
related to training curricula definitions and must be trans- 
formed to occupational definitions before they can be used in 
occupational supply analysis. Each of the components of occupa- 
tional entries has its unique problems that serve to complicate 
the provision of occupational supply information. 

Studies dealing directly with the occupational entries of 
training sources were found to vary on a continuum, "labor mar- 
ket/economic-oriented" or "educational/management information 
system-oriented." Most had as their base, a body of occupation- 
al information that attempted to support an analysis of the la- 
bor market and the fundamental problei||ts caused by occupational 
supply-demand imbalances. Although these studies differed in 
emphasis, they stressed the need for a comprehensive, multi- 
facted, timely, and accurate occupational supply information 
system. 

_ , . ■ ■ 
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Review of Occupational Training Informati on Available from 
Both Education and Nog-Education Sources^ 

This study investigates the current labor supply informa- 
tion system, the degree of undercounting and mult ipl accounting 
occurring within that system, and the factors that -affect this 
system's relationship to the overall occupational information 
system.' Attention is focused on occupational entries, specific- 
ally those completers and leavers from formally organized train- 
ing sectors. The study describes and assesses the available 
data from five major tVaining sources: public vocational educa- 
tion (VEDS), higher education (HEGIS) and NCES Services, train- 
ing under CETA (CETA-MIS), and training under vocational reha- 
bilitation' (RSA). . Specific concern is with the counting of 
persons trained in five major training sectors and the problems 
related to that counting process-. ^ 

In addition to the five major systems, other studies in the 
literature had various mixtures of the following information 
systems: State and- National Apprenti-ceship -Program Survey 
(SNAPS): U.S. Bureau of Apprenticeship and Training (BAT); Amer- 
ican Hospital Association Survey (AHA Survey );. National Guard ; 
State Police Academies Job Corp; and employee sponsored train- 
ing. No doubt, there are other sectors that could be included. 
For purposes of this study the five often studied and most prom- 
inent training sectors were chosen for review. 

P.ublic Secondary and _ 
' ' Post secondary Vocational Education (VEDS) 

The development of the National Vocational Education Data 
Reporting and Accounting System (VEDS) was .a major attempt to 
provide occupational information as called for ^he 1976 
Liendments tS the Vocational Education Act of 1963. The comis- 
sioner of education and the administrator of the National Center 
for Education Statistics jointly developed a system that in- 
eluded information on vocational education students, programs, 
program completers and leavers, staff, facilities and expendi- 
llrts. in Addition, each state was to evaluate those. programs 
for Which it receives federal funds. The state evaluation spe- 

' cifications^ertained to employment in training related occupa- 
tions and employer satisfaction with the employee. The VEDS 
system is to interface with the information system developed by 
NOICC and other (specifically CETA) information systems. With 

■ the implementation of the VEDS system in 1978-79, certain major 
changes in the availability and the concept of vocational educa- 
tion data were anticipated. The most important change was that • 
of fGl low-up information that feould provide meaningful esti- i 
mates of incremental labor supply attributable to vocational 
^ucation. in addition. " programs could be evaluated . vis-a-vis 
their labor market relatedness, 

0 
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The annual reporting* of statewide program enrollment cqm- 
pl^tion data and certain follow-up infoihmation is required to 
qualify for federal vocational educa.tion funds. The data provid- 
ed by the state vocational education agencies are compiled and 
published annually by the United States Office of Eduoation. 
Although all states prepare the same federal report^| often each 
state has somewhat different procedures for obtaining the neces- 
sary information. These differences often include the use of 5- 
individualized state forms, timing orf the informati<)p gathering 
activities, a^id collection techniques. Therefore, the resulting^ 
information is not always comparable. 

At both the secondary and postsecondary levels gtate and 
local administrations have expressed concerns about VEDS The 
vocational education enterprise is so diverse that there is no 
common nomen^clature^ A study completed in Ohio (1975) noted 
^hat high rates of mobility for youths, both geographically and 
occupati^nally , make the follow-up data difficult to obtain or 
to draw conclfisions from even the most carefully conducted lon- 
gitudinal surveys. The recent InterAmerica (1981) assessment of 
VEDS methodology and data quality are looking at some of those 
previous]!^ identified areas of concern, including the degree of 
correspondence between VEDS definitions and state definitions, 
the ident^j^ication of a state * s ability to provide data related 
to each VEDS data requirement, and the overall quality and ac- 
cessibility of VEDS dat^a. In his testimony Rolf M^' Wulfsberg 
(1980) of the National Center for Educat^ion Statistics, noted ^ ' 
that many institutions because of state policy, institutional 
choice or other reasons do not report to VEDS. These institu- 
tions, although technically eligible to receive financial as- 
sistance under the VEA, do not. These circumstances outline an- 
other potential source of supply undercounting of trained per- 
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Public Higher Education (HEGIS) 

Pursuant to Title VI of the Civil Rights Act of 1964, and 
Title IX of the Civil Rights Act of 1964, and Title IV of . th^e 
Education Amendments of 1972, all institutions that are in- 
volved with federal financial assistance to education are re- 
quired to respond to the Fligher Education General Information 
S.urvey (HEGIS), conducted by the Natiohal Center for Education 
Statistics (NCES) on thpse portions of surveys that collect 
race/ethnic data. All other yEGIS surveys are' voluntary . Th^^ 
NCES established HEGIS in 19'65-66. The HEGIS provides detaile 
data on enrollments, awards, , faculty salaries, and finances of 
the approximately 3,300 institutions from which data are col- . 
,lected. A part of this is an elaborate progr^am taxonomy of data 
on degrees and other formal awards conferred by institutions, 
including the level of the degree or other award. Award data 
are classified by type of degree or award, type of contr£^l 
(public or private), type of institution (university, other 
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four-year, two-year) curriculum 'category and xJiscipline 
specialty. The data collected at the sub-baccalaureate level ; 
a're the nCii^bers of formal awards which are classified as either 
associate degree or as 'other formal recognition*' Enrollment 
data are published but not by field of study. 

In order to estimate incremental labor supply from a train- 
ing source to a particular occupation, it is necessary to esti- 
mate the rate of participation of program completers in that oc- 
cupation. Since no follow-up data are available for/ programs in 
the HEGIS universe, additions to labor supply in individual oc- 
cupations can only be roughly estimated. The New England Re- 
gionarvcommission^ 1978) noted that double counting between pro- 
grams reported under postsecondary VEDS and HEGIS was known to 
occur. This problem ofccurs because some institutions of higher 
learning also receive vocational education funds, and, there- 
fore, must also report under t^hat reporting system. The New 
England Regional Commission (1978), noted" several cautions in 
interpreting the program information and drawing final conclu- 
sions about the importance of specific training in th^bge insti- 
tutions. A substantial number of institutions did not return 
the completed Survey in time for inclusion in t^e report. 
Therefore, those cases where an institution was aelinquent , the 
"total award" information may be un^ercounted . 

The HEGIS system has several limitations. The, taxonomy^ and 
the program detail are too broad in some areas to relate, to a 
reasonable number of occupations. In addition, the lack of any 
systematic collection of follow-up data seriously limits being 
able to estimate the rate of participation and additions to 
labor supply of program completers in varying occupations. The ^ 
data. collected pertain to the numbers of those .persons receiving 
formal degrees or certificates and exclude persons who were 
trained but did not receive certificates. 

The HEGIS reporting system does provide the occupational 
analyst with annual a.nd reasonable timely information . on occupa- 
tional program completions in a large number of postsecondary 
institutions. It is a valuable resource of information* > con- 
sistent in scope and quality from year-to-year, and comparable 
between states. The availability of this data for individual 
institutions makes the information useful for substate analy- 
sis . * 

Noncollegiate Postsecondary Survey (NCPS) 

The majority of occupational programs and enrollments in 
lioncollegiate postsecondary institutions is found in profit- 
making or proprietary schools. School licensing of figes within 
most state education departments collect some lA-aining data from 
pVop'rietary schools as a part of the license application and re- 
newal procedure. These agencies usually are not able to produce 
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these data in a systematic and comprehensive fashion. In recent 
years spme progress has been made in^he provi&ion of informa- 
tion concerning proprietary and other noncollegiate postsecond- 
ary institutions offering occupational training programs. Be- 
ginning, in 1971, the National Center of Education Statistics 
began surveying a Universe of noncol legiate post secondary 
schools with occupational programs . The survey is conducted 
every two years and t^rie universe is continual ly supplemented 
with information from state directors of vocational 'education 
and other sources, such as licensing and accrediting commis- 
sions. 

The unpublished data from the NCES survey provide informa- 
tion on the number of enrollments by program, and by inistitu-^ 
tion. Programs are classified by U.S. Office of Education pro- 
gram code. Schools without occupational programs are elimina^ted 
from consideration. InstiJ|[utions are classified by ownership; 
public, proprietary, indej^ndenl/^ nonprofit, or rel igious affil- 
iation. Programs are coded based^on the program title provided 
by the, respondent. 

In addition, NCES surveys a SyEmple of the universe to gain 
more detailed information about • students and completers. 
Although much of the information collected on the sample is 
identical to that collected on the universe, the addition of 
program completion data allows . for more comprehensive national 
estimates to be made. Other information about length and 'COst 
of program and supplenfental sources of funding are collected for 
national estimate purposes on a universe of noncollegiate post- 
secondary occupational programs, including proprietary schools . 
The data are available every two years and includes enrollments 
by U.S. Office of Education program code, by institution. In 
addition, national estimates based on '^a sami^^le' of the universe 
are made of other program characteristics including completions . 

The user of NCES noncollegiate pc&stsecondary^ da,ta should be 
aware of certain instances where fnulyiple counting between sec- 
tors occurs. Postsecondary .data from the survey may also be ac- 
counted fqr in the vocational education reporting system. 

As with graduates of institutions of higher education, no 
follow-up information is collected from graduates or leavers of 
accupationa'l training program in/ noncollegiate postsecondary 
schools. The New England Regiocial Commission (1978) noted that 
this lack of information serioi/sly hinders the ability of ana- 
lysts to relate training to th^ labor market. Flinrt, Scheer and 
Schmidt (197 5) recommended th^t the state registr^sition require- 
ment for these private institutions be extencjed to include an- 
nual reports of enrollments, completions, and terminations by 
programs. ' , 



In summary, information on postsecondary, noncollegiate 
training is available from the National Center for Education^ 



statistics. This institution-specific information is consis- 
tent in definition across states,. and, thus, can be a v^^luable 
source of training data. 

if 

Classroom Training Offered by Comprehensive Employment and 
Training Act (GETA-MIS) ' ; 

^ The enactment of t^he Comprehensive Employment and Training 
Act (CETA) of 197 3 pt-ov'ided for vocational training and job 
placement on a decentralized basis to economically disadvantag- 
ed, unemployed, and ^underemployed individuals. The decentral- 
ized structure of the CETA program enables the actual adminis- 
tjiation of training programs to proceed at the local level. 
Units of local government such as cities or counties- with a pop- 
ulation of ^ hundred' thousand or more are designated as Prime 
Sponsors with Balance of State provisions for less populated 
sections. The Prime Sponsors and Balance of State' are respon- 
sible for, the administration of th.e CETA programs within each 
state as well as being responsible for the collection and. ac- 
curacy of the relevant program data^ The CETA program activity 
exists in two forms, classroom trainijig and vocational work ex- 
perience. 

The United States Departm'ent of Labor, Employment and 
Training Administration (ETA) is the federal agency that has the 
responsibility for distributing federal monies to the Prime 
Sponsors. ETA also supervises the collection of quarterly data 
relating to CETA program activity. " These quarterly data produce 
a summary view of the general changes during the three month 
period prior to, Prime Sponsor reporting. The most relevant in- 
^ formation on labor market activity is the information oh total 
enrollments, total terminations, participants/enrplled, «an.tici- 
pated duration of job placement, and rehired- worker s. Again, 
this information would ^be more useful if it were occupation- 
specific. 

Each Prime Sponsor has. an established data collection sys- 
t^em that is known as the Management Information System (MIS) . An 
MIS specialist is assigned the tasks of collecting, editing, and 
processing the data related to local CETA activity. Types of ^ 
information available from these Prime Sponsor systems, the 
level of system automation and sophistication vary considerably 
among Prime Sponsors. 

Various limitations of the CETA data ;have been noted. A 
major deficiency is the lack of -a comprehensive, standardized 
system for compiling information on the occupation-specific na- 
ture of CETA classroom training programs. Until recently, .few, . 
if any requirements exist for the reporting or routine compila- 
tion of occupation-specific training- data. Th^ variability in 
data availability among Prime Sponsors makes the use of the data 
for state or regional occupational training analysis in- some ; 
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states difficult. The occupational training data extracted from 
each different Prime S^ponsor ' s MIS is ofiten extremely variable 
in detail and quality. ' 

Most Prime Sponsors, to one extent or another, follow-up 
individuals, served by the various CETA programs. However, in 
few cases does the follow-up produce information relating the 
specific occupational outcome of CETA's occupational training 
programs. ^ 

, , In summary, the lack of a standardized systeiit for collect- 
ing and reporting information on CETA occupational- training en- 
rollments, completions, and occup^ional outcome severely limits 
the use of data available from individual prime sponsors. In ad- 
dition the variation among prime sponsors of data availability 
andf detail serves to limit their utility. 

Training Through Vocational Rehabilitation (RSA) 

One of the oldest and„ most coniprehensive federal human re- 
source programs is vocational rehabilitation. The origin of 
vocational rehabilitation is the Smith-Fess Act of 1920^ which 
provided matching vocational education funds for training those 
disabled through industrial accidents. Since that time voca- 
tional rehabilitation has evolved into a comprehensive program, 
administered -at the national level by the United States Depart*- 
ment of Education, Jlehabili tation Serviees Administration (RSA). 
This program consists *^f a variety of support services provided 
to clients, including vocational training, job development, 
placement services, and follow-up support to ensure adjustment 
to employment. 

Services for vocational rehabilitation are available' to the 
handicapped in all states. To qualify, the applicants must have 
a disability that , interferes with their continued employment. 
The vocational rehabilitation agency in each state administers 
ttie vocational rehabilitation program in that state. In most 
cases, occupational training is not provided directly by the vo- 
cational rehabilitation agenpies , rather it is provided indi- 
rectly by referral to training instittitions . 

The data collected by vocational rehabilitation agencies 
have been described as administrative in nature. This means 
that the data are intended for management, control, and evalua- 
tion uses, rather than for occupational information, human re- 
source research, or planning. Of the data elements gathered, 
those most related to occupational information are the ^follow- 
ing: address reference, sex, work status before and after 
training, occupational title after training is' completed , length 
of training program, outcome of services, and general informa- 
tion about type of training. 
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The primary source of problems associated with vocational 
rehabilitation data noted by the New England Regional Commission 
(1978) was that the data .have not been available in a ^systematic 
fashion. The data are collected at the state agencies and for- 
warded to the national of f ice .of the RSA, where the data are 
used administratively. After the RSA ^finishes using the^data, 
the magnetic tapes on which they are contained are returned to 
the various state agencies for reuse. The original, raw, or in- 
put data are never entered into an irifcSrmation system that would 
allow access by lator- market analysts or other interested^ users 
at other levels. ' ~ 

Vocational rehabilitation's inclusion in the occupational 
information system takes the visible form of representation on 
each State Occupational Information Coordinating Committee. Ih 
addition, commissioners of the RSA designate a person from their 
staff ° to' work witli the technical steering group of the National^ 
Occupational Information CooTfUnating Committee. -Since most 
training for RSA clients is done by another agency, the poten- 
tial fot multiple counting is great unless .supply data ace used 
only" from the source of training. 

Summary - % 

The previous sections contained a discussion of training 
infdrmation for the f.ive most common training sedtors studied. ^ 
This section will summarize the most commonly addressed prob- 
lems, constraints, and recommendations regarding »fehe vocational 
education and training system that are discussed in the litera- 
ture. - . „ 

A lack of consistency and coordination in the "system" of 
vocational education and training information permeates the lit- 
erature. Several studies indicated anticipation of the develop-- 
ment of NOICC and the SOICC the possible remedy to this prob- 
lem. There has not been an existing mechaqrsm or process to ^ 
coordinate thfe various component information systems of the dif- 
ferent training sectors that could provide a unified, consistent 
reporting of data and information. In most instanbes, some data 
are available indicating the number 'of enrol litjent s m,' and/or 
the completion of, training programs. In many instances th^re 
is much available information, yet it varies considerably , in the 
level of program and geographic detail and m-the quality ot 
reporting and editing." In many instances, multiple counting 
exists. Training data available! for an occupational program 
offered by an institution in one sector is tabulated by^two or. 
more data collection agencies. However,- the more global problem 
is the lack of a comprehens ive ^follow-up of occupational program 
complet'ers. 

Several studies agreed that double counting occure amdng 
the various training sectors. Duplication of count agists m , 
the HEGIS Survey and the postsecondary VEDS . Less multiple 
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counting occurred between HEGIff and the^ NCPS Noncollegdate Post- 
secondary Survey. Some multiple counting did occur between the 
public portion of the NCPS Postsecondary Survey and the Postsec-" 
ondary VEDS . It was frequently noted that multiple counting 
does '^xist 'between pETA-MIS and VEDS. Problems of inconsistency 
and undercounting were a Tso. discussed , even though the actual v 
tracking and identification of data were moE,e difficult to as- 
certain. These instances of multiple counting and undeftcounting 
among training data sources dilute the validity .of the data pro- 
duced. ■ , . 

A wide variety of constraints influence management informa- 
tion systems CStacr, Black, and Gray 1977). These nondata or- 
iented constraints include inadequate staffing and staff train- 
ing; noncooperation; lack of administrative support; misunder- 
standing-'o^ the MIS and its role; not enough organizational 
support and^ recognition of MIS; little time to make improvements 
in MIS; lack of staff trust of the MIS or the data; variations 
of fiscal years among local, state, and, federal agencies; and £ 
political influence ip personnel ^selection. Those data-speciffc 
constraints have included unclear or cx)ntradictory definitions, 
limited data access Capability, poor computer center service, 
low priority status on computer, insufficient funds for MIS or 
data system impT?ovemen t , and limitec] physical access to computer 
and data centers. ^? 

The.mo^t comprefiensivc recommendation suggested to correct 
this overall px;gblem of multiple counting, undercounting, and 
the related constraints was the development of a formal' mechan- 
ism for establishing reporting standards, ' the" coordination of 
reporting systems, and the rationalization of the data. . The 
conceptual origins and development- of the NOICC/SOICC network 
have been a direct res-ulfof this felt need. This formal mechan- 
ism is an agency (ies) having the »f oil owing characteristics: be 
institutiorially neutral such that its responsibilities would not 
imply lines of authority or; hierarchial statu^; recognize the 
mix •of-'^ttie public and private institutions involved; have the 
technifcal capacity to process educational and . training .informa- 
tion into supply estimates on a timely basis; ^and be iifi pr.oxi- 
tnate relationship to sources of human .resource requirements in- 
formation in order that data demand and supply estimates be 
translated into policy or ^choice criteria" for educators, ad- . 
ministrators, ^xalicy analysts, labor-market analysts, and var- 
■ious decision- makers. The fulfillment of theSe recommendations 
was seen as embodied in the deve lopment- of the National Occupa- 
tional In^ormaticin Coordinating Committee (NOICG) and the State 
occupational Information Coordinating Cemmittee 



itv of information about bothT.dbor demand and labor supply. 
They hdve reasoned that with the availability of rtiore accurate 
occupational supply' and demand^^irif ormation^, ",1)^ h.ug'e sums spent 



or! vocational education, higher education, training, and unem- 
ployment compensation could be more effectively utilized."^ The 
use of such information could cireate a better -understanding of 
the occupations in demand, as well as those occupations for 
which there are a surplus of trained in<iavi4uals or no demand. 

In recognition of the need to improve occupational sijpply 
and demand information. Congress established in the Education 
Amendments of 1976 (P.L. 94-482) the National Occupational In- 
formation Coordinating Commmittee (NOICC) "for each state. The 
NOICC and SOICC as discussed in A Framework for Developing an 
Occupational Information System ( 1979 ) , are charged under this 
legislation with the 'fa&^litation and coordination of the de- 
velopment of an Occupational Information System (OIS) that has 
uniform definitions, standardized estimating procedures, and 
standardized occupational classification and reporting methodo- 
logies, i ' • ' 

Given th'e specific responsibilities assigned to NOICC and 
the^SOlCCs, the states, as noted in the various preliminary . re^ 
ports of West Virginia (1980), Oklahoma (^1980), Oregon (1980), 
Kentucky (1981), and ^others, have found it critically important 
to design their own -subsystem and model of occupational infor- 
mation in direct line with the NOICC guidelines for development 
of labor s'upply models. The NOICC and the emerging SOICC net- 
work is charged with action at the national and state level to 
implement a compreiiensive occupational information system. 

■ • ■ . ' ' . I • ' 
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Appendix b 

overview of federal laws and regulations 
pertaining to data collection and reporting 

State Occupational Information Coordinating Committee (SOICC) 

Congress mandated the ' establishment of the National Occupa- 
tLional Information Coordinating Committee (NOICC) and the State 
Occupational Information Coordinating Committees (SOICCs). The 
Education Amendments of 1976, P.L. 94-482, Title II, Vocational 
Educationv Section 161 (b) (1) and (b) (2) mandated the estab- 
lishment of NOICC. The legislation stated that the primary 
purpose of NOIGC shall be as follows: 

/ To develop and implement an occupational information 
system to meet the common occupational information 
need9 of vocational education programs and employment' 
and training programs at the" national, state, and lo- , 
cal levels, which system shall include data on occu- 
pational demand and supply based on uniform def ini- 
.tion, standardized estimating procedures, ' and stan.dr- 
^ardized occupational classifications. 

The State Occupational ' Information Coordinating Committees 
are charged with coordinating the necessary resources to develop 
and -implement an Occupational Information System. 

Vocational Educatipn Data System (VEDS) 

The Education Amendments of 1976, Public, Law 94-482, Title 
I.I, Section 161 (a) legislated the development, implementation, 
and operation of a national vocational education data and ac- 
counting system.,. The legislation mandates that the commissioner 
' of education and administrator of the National Center for Educa- 
'tion Statistics be given joint responsibility for development of 
the system's information elements and uniform definjLtions and to 
provide for the uniform reporting from the stages. It is man- 
dated that the system ^be compatible with the Occupational Infor- 
mation System (OIS) l:?e*ing developed through SOICC and other in- 
formation systemsiinvolving data on programs assisted under CETA 
of 1973. ' 

VEDS form^ include the following: 

NCES 2404 — Program Enrollment aQd Termination 
Report . Thi:^form requires sepaiTate reporting 
for secondajry and postsecondary . ^ ^ 

tm^ee parts: ^ 



The form has 



Part A---repprts information on occupational 

preparation, enrollments , and termina- 
tions which may be included in the 
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follow-up. Informatioji is by six-digit 
OE code programs. Information 
includes : 

o unduplicated count of total instruc- 
tional program enroll me nti^^iring th 
: reporting year; 
o unduplicated total"" counts of program 
enrollments by i^acial/ethnic group by 
^ex; 

o unduplicated enrollment counts ,by 
program level ; 
- * o enrollment data pn short-term 
adults ; • 

o undupli-c^ted counts for enrollments 
^with special needs (handicapped, 
limited-English prof icienqyV disad- 
vantaged) ; 

* o unduplicated count of enrollments in 
, cooperative vocational education;, 
o unduplicated ^counts of students^ who 
complete, transfer from, or leave a ' 
program for any reason during the fce-^n 
porting year. " ^ 

Part B — reports on program enrollments^'and ter- 
mi nations jEor whom thejfe will be ho^ 
, follow-up. Separate repor\ting categor- 
ies include — ^ 

. o occupational preparation for those 

below eleventh gi^ade enrolled in ^ ^ 
occupational preparation programs,, 
enrollees in bourses prereqi^site. to 
^ -a six-digit OE code program/^f i a pror 
-gram or activity that leads to more 
than one six-digit OE program, 
o consumer and homemaking j)rograms , 
o industrial arts^programs . ^ 

Part C^-reports on the instructional settings of ^ 
handicapped enrollments. 

NCES '2404A — ^Postsecondary Program Enrollment and 
Completion Report ^ This form aggj^egates fJata at 
the state -level by institutional type (str'eam,) on 
annual cumulative student enrollments dnd. comple- 
tions in postsecondary programs of vocational' ed- 
ucation. There are five parts tj||j^he form: 



Part: A — provides information'' on enrollments and 
~ completions who may be included in the 
follow-up. Information is reported by 
either six-digit OB code or four-digit 
HEGIS classification when six-digit 
codes are not available. Information 
includes — 

o unduplicated count of total vocation- 
al program enrollments during the. re- 
porting year; 

5 unduplicated total counts of voca- 
^ tional 'program enrollments by racial^ 
ethnic group and by sex; > 

o vocational program enrollment data 
for those students with special 
needs; * * 

o unduplicai^d count ^of those students 
who complete program during the re- 
^ ^ porting year. 

Part B- — reports other vocational and support 
'■ program enrollments for — 

o occupational preparation programs for 
those enrolled in an area of voca- 
tional education at the two-digit 
level of specificity, 
^^^^^ o consumer and horaemaking programs, 

o industrial arts programs. 

■* * 

Part C--i:'eports special needs enrollments in 

Parts A and B by < type of instructional 
settirig V 

'Part^D — provides un^duplicated reporting of en- 
rollments in parts A and B who are par- 
.ticipating in co-op vocational education 
and apprentice programs ^ ^ ^ 

*Part E — provides " enrollments^ who benefit from 

^ - worK study, .support services 'for women, 
day care services, vocational education 
for displaced homemakers, and consumer 
and homemaking* vocational /education pr'o- 
grams in economically depressed aredfs. 

KtCES Teacher Staff Report . This Report ^ 

is" separated by secondary and Bpstsecbndary data 
The reijort aggregates data at the state level on 
sliaff assignments in vocational education. * NGES 
.,2404A-1 is the postsecondary version of this 
formv \ 

■• . ' ■ , \ „/. - i 



NCES 2404-2~Financial Status Report > This re- 
port provides information on expenditures of vo-^ 
cational education funds. 

NCES 2404-7 — Coirtpleter /Leaver Follow-up This re- 
port requires separate reporting for secondary 
and postsecondary • This defines the ^follow-up 
universe from NCES 2404. It includes an employer 
universe of those individuals who indicated being 
employed in fields related to their vocational 
training. States are required to use a minimum 
sample of 20 percent. NCES expects a reasonable 
response rate; ^ * 

aggregate report of the employment ^, 
status of the fo'llow-up sample by in- 
structional program by completers, 
leavers who complete more than 50 per-^ 
cent of the program and summary of 
leavers who complete at most 50 percent 
of the progr^. 

Part B - -aggregate of the follow-up employment 
status by rax:ial/ethnic designation. 

Part C- -aggregate of the follow-up employment/ 
C status of handicapped completer/leaver. 

Part D — reports the fields of employment' for 
7"^ ^ completer/leaver follow'-up and average 
hourly salary by instructional program. 
* Each form will be assigned a two-digit 
SOC code based on individual's employer 
job title, and job duties* 

NCES 2404A^7 — Postsecondary Completer /Leaver 
Foll6w-up^ Report^ ^his report is due one year 
aftei: submitting NCES 5404A. Data on vocational 
education programs are identified by stream's. 
They <3efine the follow-up ' uhiverse as consisting 
only of the completers who can be identified with 
a specif id^six-digit vocational education pro- 
gram, and leavers who did not return to enroll, in 
>two consecutive semesters or three consecutive 
quarters or who notify the insti-tution of their 
intent not to enroll again f^rior to program com- 
pletion. The 'report includes an employer ' uni- 
. v^rse of the employef s of ^individuals wh'b indi-^ 
cated that they were employed in fields .related 
to their vocational training. 

■ . ■ ■ ... I • 
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NCES 2404-8— Employer iFolIdw-^ujE . This report' 
•summarizes the information results *from EmpliSyer 
Follow-up forfns. It reports result's by irtstrud^ 
tional programs, by racial/ethni c/sex designa- 
tion, and by program level/completion status of 
* students on whom data were reported. ' 

Part A — reports findings by instructional pro*- 
gram. " 

P^rt -reports findings by racial/ethnic/sex 

designation on those reported part A. ^ 

Part C — reports findings ti^^rogram level and 
completion stdtu^.^^ 

The secondary forms report data on vocational education for 
whpich* credit is given toward a high school diploma.^ The ppst- 
secondary forms report data on vocational erducation from three 
streams: regionally accredited institutions (i.e^ HEGIS \^ 
schools'); state approved institutions (generally area vocational 
technical institutes or /institutions established^ by state law or 
'policy); and other postjsecondary institutions. Each stream re-^ 
qu 



ires a separate form./ 



Comprehensive ^mployment and Training Act (GETA) 

Public Law 95-524, the CETA Amendments of 1978,. calls for 
the governor's coordination and special services activities to 
incline the coordination of all employment and^ training educa- 
tion and 'related" sorH^ces by providers of these services within 
the state; and the exchange of infonma£i6n between' s^a«tes * and , 
prime sponsors, with respect to state, interstate, , and regional 
planning for economic development, human resource , development , 
education /^nd ot^er subjects relevant to enifiloyment , and l^raining 
planning. , The CXTA Amendments require evaluative information on 
enrollment's, coril^letions , jcrb placements, and training related 
placements for clasroom and OJT prograirts, 

' ■ * \ ^ - ■ 

CETA is administered by the Employment and Training Admin- 
istration vof #the United^tates^ Department of Labors ETA pro- 
vides £un<% to prime sponsors "to conduct CETA activities. 
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Quarfcferly and annual reports sent to the regional offices 
include t^'e following: 

1 . ■ ■ ' ■ • 

t?l.v' Quarterly Summary of Participant Characteristics 



(QSPC), provides detailed information on the 



> socioeconomic characteristics of participants. 



For the cakegories, total participants, total 
, terminations, and for the total number of parti- 
cipants vmo entered employment the following^ is 
'9/; report^dZ sex, age, education, economic status 



family status^ race/ethnic group, veteran cate- 
gory, and labor force status Fpr those clients 
who entered employment hourly wages prior to CETA\ 
participation and hourly wages after CETA parti- 
cipation aire reported.* This is reported by the 
prime sponsor on a quarterly basis for each CETA 
title. ^ 

CETA Program Status Summary (CPSS), provides ag- 
gregate information on the outputs of CETA pro- 
grams on a quarterly basis. ^ \ 

Section I: Reports information on enrollments, 
terminations, and^ spme limited .in- 
formation on post program employ- 
ment status and expected^ duratibn 
of job placement. . 

Section II: -Reports information on the numbers 
^ enrolled by CETA program activity 

(e.g. classromxtraining, on-,the-job 
training, pu^^c service employ- 
ment, and work experience^. 

Section III: Reports information pn significant 
segments, both planned and actual. 

The Annual fCETA Program Activity Summary ( PAS ) , 
reports the outcomes of CETA program terminees 
according to the program activities in which th^y 
participated and whether they pa'rticipated in a 
single activity or in multiple activities. Re- 
ports aggregate numbers of participants who 
entered public or private sector employment, 
those who entered the armed forces, returned to 
or continued full-tinle school. 

Annual Report of Detailed Characteristics , re- 
ports by race/ethnic group by sex the following 
information: age, -education status,- public as- ^ 
sistanoe status, economic status, fa^^ly status, 
and veteran status. 

Annual Report of Training Enrollments and Comple - 
tions (this report becomes a CETA reporting 
requirement during FY 81 and will be due in 
November of 1981 ). Occupational Classifica- 
tions are made usirig either ninerdigit DOT or 
four-^git SOC codes (not both in the same 
report). Activities that cannot be coded to 
that level of detail are coded to the finest . 
level of detail possible.-. Classroom training 

. ' ' ^ ' ' ■. 
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reports enrollments and compl'etions in occupa- 
tional skills operated by the prime sponscJr or 
^ cohtrat^tor. , t 

On-the-job training reports enrollments and 
completions. 

All CETA Prime Sponsors an(a BaXance of States (BOS) report 
that forms required by the U . S. Department^ of Labor *are com-' 
pleted. This information is sent to ^ch of thfeir respective 
regional offices. No other data on . participants or programs 
were collected except the data necessary to comply with federal 
requirements. All CETAs collect data by incjividual participant. 
Seven of tVie sta'tes report a system using individual participant 
social security numbers to avoid double counting within the ag- 
ency. Only a few of the CETA agencies state that they have the 
capability to determine if a client is an individual referral or 
in a group referral wi.thout making ch€inges>in the reporting sys- 
tem. This information is on the individual records, but is not. 
coded for access. , 

Higher Education General Education Survey . (HEGIS ) ^ 

* ■ 

A Taxonomy of Instructional Programs in Higher Education / 
The Higher Education XSeneral Information , Survey (HEGIg) , . ^utljor^ 
ized.by law (20 U.S. Code 1221 e-1), was established in 1966*^67. 
Data are to provide comprehensive^ ins|.itutional-base.d informii- 
tion on the status of ppstsecondary education in the Uniteci 
States. The nationwide system iis a mandated responsibility of\ 
NCES. NCES collects, edits, >analyses, and disseminates dai:a on 
the nation's public and private colleges, universities and com- 
munity colleges. : ^ 

Several forms and some surveys are conducted annqally,, 
others are conducted less frequently. 

o Institutional Characteristics of Colleges and 
Univetfsities (annual), j • , 

o Fall Enrollment ai^ Compliance Report 

(annual ) . . ^ . ' 

' o Financial Statistics of Institutions of Higher 

Education ('annual). ^ i 

o tapper Division and Postbaccalaureata Enroll- 
ment (annual) . ^ ^ 

o Degrees and Other Formal Awards Conferred 
(annual ) . 

b Employees in Higher^ Education (part annual and 
part biennial) . \ . . ' 




o Inventory of College and University Physical 
Facilities (periodic). 

^ * o Adult Continuing Education (periodic) . o 

Residence^and Migratioj^ of College Students 
(periodic) • 

-Instructional programs ^are coded with a unique HEGI& codrng 
taxonomy. Information includes the following: 

1. Programs of two or more^years, but less than 
^ four years by ^sex and racial/ethnic data. 

a. Associate degree. - « 

b. Other formal recognition (without asso- 
ciate degree). ^ 

* . ^ . f , • . ^ 

2. Programs of at least oriV year, but less than 
* two years / by sex, racial/ethnic data* 

Vocational, Rehabilitation Management^ InformatJfOn System 

: ■ n 

^ The Rehabilitation Act of 1973, Public, Law 93-112 au1;hor- 
izes grants to assist states to meet the current and future 
aeeds of handicapped individuals. la ordrer to participate a 
State must submit a state plan for vocational rehajbilitation 
services fp?^ three-year period and may be required to make an- 
nual, revision^ in the plan upon th6 request of the RSA commis- 
sio.ner. . 

Statistical reporting under the federal-state program of 
vocational rehabilitation is spons^ored by the Rehabilitation' 
Services Administration .(RSA) and conducted under the auspices 
of the National Center for SociaJL Statistics (NCSS) acting as 
the collecting and processing agency for RSA sponsored reports. 

RSA specified what information \yill be collected and at 
what points in the service-delivery process. States have the 
option of using the SRS-RSA-300 form or can collect the speci- 
fied information in a manner compatible with their data system- 

Occupations of .vocational rehabilitation clients are re- 
corded at the time of case closure. The occupational coding 
structure is based on the DOT code. Generally the first four 
digits of the six-digit code are used^. ^ ^ 

NCES 2358-1 . Survey of Programs and Enrollments Postsec- , 
ondary Sqhobig, Correspondence Schools Only. Information in- 
Cludes by qccupational program or field of training: total num 
ber of required responses; average number of months to complete 
program; average number of hours to complete program; if. resi-^ 
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dential requirements; nbumber of hours required; total required 
tuition and fees; number of students ever enrolled ifr. year; and 
number of students completing the program. 

Schools are further classified by 'the type of control of" 
the institution. Public schools are those controlled by f^d-^ 
eral, state, or local government. Private schools are those 
operated either as a proprietary < profit making) school or 'as a^ 
independent, nonprofit making school. Correspondence schools^ 
are classified by type. / 

Three forms are used: NCES 2358; NCES 2358-1; and NCES 
2358-2. Apj^oximately 80 percent of the universe of schools re 
ceive the one-pagfe survey f6rm ( NCES-2 ) . ^ NCES 2358 is a long . 
form survey sent to the remaining 20 percent of the schools 'se-* 
lected by random "^tratif ied sample. The third ^ form (NCES 
2358-1) is sent to correspondence schools. 



NCES^358-2 * Survey of Programs and Enrollments, Postsec- 
ondary Schools and Career Schools. Information includes by pro- 
gram: n*umber of enrollments by sex, number of completions by 
sex, full or part-time status of enrollees. 

NCES 2S58 I Survey of Programs and EnroXlmegts Postsecpnd-^ 
ary Schools. Information includes that on 2358-2 (by progra^) 
in ad<3iti6n to the length of the - program, number qf hours per 
week of required attendance for full-time enrollees, total 
. cl;i€rrges to' complete the program (tuition, booksi supplies^ the 
and so forth) , number of leavers before completion with market- 
able skills by^ sex, the number of program dropouts by sex, the 
number of continuations or^ the number whd are still enrolled by 
sex. 

-* " ■ . ' • 

^ fJoncollegiate Postsecondary (NCPS) 

, » • ' . » 

The Natiojial Center for Education Statist iop (NCES) is re- 
sponsible for a biennial survey of all public ' and private nOn-^ 
collegiate postsecondary schools offer^ing one or more Qccupa- >^ 
^^^^nal programs intended to prepare individuals for*>i specific ^ 
career. . Noncollegiate postsecondary schools are surveyed in 
even numbered years to obtain enrollment and completer/ leaveif 
information. \ 

The noncollegiate schools are classified according to the. . 
following types of occupational programs offere'd: v 

Vocational-Technical » 

Technical Institute * * 

- Business/Commericial/Of f ice * , 
Cosmetology/Barber . o 

^ Flight School , ' * . * 

Trade :^chool , ' . . 



Arts/Design 
Hospital 

Allied Health . 

^(Schools not classified in the these groups include schools of 
modeling, brewing, maritime occupations, and horseroanshil>» ) 

Job Corps 

Job Corps, is mandated by Public Law 93-203, Comprehensive 
Employment and Training Act, Title^ IV and amended by Public Law 
95-524. Job corps provides intensive programs of education, vo- 
cational skills training, work experience counseling, i^nd health 
services on a resident or nonresident basis. The centers are 
targeted to disadvantaged young people, between the agfes of six- 
teen and twenty-two v#o are out of work or school an<J who need 
additional skills. ^ 

• Job Corps uses- three forms to collect data; Job Corps Data^ 
Sheet, semiannual Vocational Status Report, and an individual 
follow-up reports ^ ^ 
k ^ ' ^ . 

The Job Corps Data Sheet is an intake form tjiat is coniplet- 
ed for each individual. It screens applicants for eligibility 
and. collects background and personal characteristics iriforma-' 
. tion» 

The semiannual VocatiQnal Statua Report , reports vocational 
training programs by Job Corps cluster and by six-digit DOT 
code. Information reported is the source cff instruction • (e.g. 
center staff, ^contractor, union, college); the number of enrol- 
lees in center/off center and by sex; total enrollment; and 
number of completions of Job Corps training • 

\ • 

The follow-up report is completed for every leaver regard- 
^less of completion, if that member can be located Information 
incl^des; geographic area. Job Corps identifiers for the voca- 
tional training program completed, job title and type of job ob- 
tained, the DOT code for the occupation of placement, and the 
relationship of employment to training program. 

Reports on enrollments and the Vocational Status Report are 
sent to the regional office. the regional office does the 
foll6w-up' report and it is not returned to the Job Corps center* 
The follow-up reports are sorted by the home state of the Corps 
members. • 
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APPENDIX C . . . 

^ RESPONDENT COMBi^NATIONS 

In analyzing the quantitative data collected, respondents 
were aggregated by title into various groups. The various qomr 
binations are listed as follows: r . 

State Secondary: ^ 

State director of vocational educatiol^ 
Stajte MIS director, vocational education 
Vocational education planner 

State Pos t secondary : , 

Post secondary head 
HEGIS coordinator 



\ 

I, 




CETA: 

All CETA respondents! 

v. 

Lpoal Secondary: ^ 

Vocational education director 
Vocational educatTon MIS 

i ' • ^ ^ 

Local Post secondary: 

Vocational education director 
Vocational education MIS 

Administrators: . * , - ' ' 

State director of vocational education 
SOICC 

. . Postsecondary head 

Vocational rehabilitation 

Local secondary vocational jediication director 
-Local pos€secondary vocational education head^ 
CETA prime sponsor training director 



J 



Management Information Systems: 

' " • 

State vocational education MIS ; ^ 
Planner , vocational educatron 
HEGIS coordinator 

CETA balance- of state HIS " ^ 

Local secondary vocational education MIS ^ 

Local postsecondary vocational education MIS 

/ ■ 
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Combined Postsecondairy : 

HEGIS coordinator r , * • 

State postsecondary head <? 
Local postsecondary vocational education head 
Local postSjpcondary vocational- education MIS 

A 

Combined teiBCondary: ^ ^ . * 

State director of vocational education 

State vocational education MIS 

State planner, vocational education 

Local secondary vocational education director 

Local secondary vocational education MiS 
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■ ^ ' APPENDIX D 

STEERING COMMITTEE 



National Occupational Information Coordinating Committee 

^ Dick Deml^sey 
Jim Vfoods 

National Center of Education Statistics j 

Curt Baker ~ HEGIS 
Lynn Kay — PostsiSSondary Survey 
Bob Morgan — VEDS 

7 

Rehabilitation Service Agency 

Patricia Nash 
Comprehensive Employment and Training Act 

Bob Beasley 

.Leo Kouter^ — Pennsylvania 
Job Corp 3 

Gene Sullivsgi 
State^ Vocational Education 

Tim Campbell — Florida "\ . 

^ J 
State Occupational Information Coordinating Committee 

Mark Schaff — Ohio j k 

Jeffrey A. Windom — Virginia - I 

Bureau of Labor Statistics 

Brian MacDonald |^ 



Peter Ward 



Office of Vocational and Adult Education^ 



a 



Kent Bennion 
f Bernie McAlpine 
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INTERVIEW GUIDE 
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Concept: Double Counf ing/Under Counting 



Variable 



Funding 



CO 



01 



02 



Automation 



r^^9^ 102 



03 



04 



d5 



06 



07 



Do you have students in programs that are 
supported by mor'e than one funding soyrce? 



What are these sources? 



J 



How many reports are made on each of 
these students? 



To whom are these reports sent? 



What is your estimate of students that 
may be double funded? 



From-whom do you receive funds for 
programs? ' ' ' 



How automated is your MIS system? 



8 □ Don 't Know 

9 □ Not Applicable 



s 

Response 



(10) 1 □ Yes 
2 a -No 



If yes, ask next question. 

(11) 1 □ CETA 

(12) 2 □ * BEOG 

(13) 3 □ ' Rehab 

(14) 4 □ VETS . 
05) 5 □ WIN 

(16) 6 □ Voc. Ed. A ■ 

(17) 7 □ Other (Specify) 

(18) 1 n 1 

.202 

3 □ -More 

t19) 1 □ CETA (Regional) 

(20) 2 □ Voc. Ed. (State) 

(21) 3 0 Dept. of Ed.(VE©S) 

(22) 4 □ NCES 

j23) 5 □ Other agencies (Specify 

(24) 1 □ 0-25% 
2 □ 26-50% 
ZS3 51-75%- 

4 □ 76-100% 

(25) ^ □ Federal 

(26) 2 State 

(27) 3 □ Local ■ 

(28) 4 □ Other (Specify) 



(29) 1 □ 



-Oh 

2 U\2 ^ 

3 □ ^ 
4^4 

5 □ High 
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Variable 


Questions 


Response . 


) 

Reports^ 


08 


What reports are used ,to calculate supply? 


(30) 


1 


□ 


CETA ' , 






* 


(31) 


2 


□ 


HEGJS 








(32) 


3 


n 


Employment Servkes 








(33) 


4 


n 


Vocational Education Reports (VEDS) 




r 




(34) 


5 


b 


Proprietary School Reports 




\ 




(35) 


6 


□ 


OtheySpecify) \ 


Interaction 


09 


How frequently do you interact with other 


' (36} 


1 




Daily 






agencies' MISs within your staje? 




2 


□ 


Weekly 










3 


n 


Monthly 






- i ■ 




4 


n 


1 fts'i FrenuentIV " 


Agency Control 


10 


How great a priority is data collection? 


(37) 


1 


n 


Low ■ . • 






2 


□ 


2 • 








. t 


3 


m 


3 










4 


□ 


4 


• 








5 


n 


High ' . ' ' ^ 




n 


Does your data have any impact on your 


(38) 


1 


n 


Yes 


> 




funding level? . ' * 




2 


n 


No 




12 


How much pressure does your system place 


(39) 


T 


□ 


Low 






nn vnii tn Hin ;irrin^tp and comolete 




2 




2 






reporting? , * 




3 


□ 


3 . • 


V 








4 


□ 












5 




High*^ ■ 




1 Q 
i D 


How much control do you exert on local 


(40) 


1 


□ 


Low 






schools to do accurate and co,mplete 




2 


n 


2 






reporting? 




3 


n 


3 - • • ' . ■ ' ■ 










4 


□ 


.4 , . . 


til. 








5 




High ■ , 






W ildL IS.IIIU UI LUMLiUI uUCa IMC diaic iiavc ^ 


(41) 


1 


□ 


Laws or Regulations 


• 




on the local school to get reports? * 


(42) 


2 




Funding 






(43) 


3 


□ 


Persuasion ' ' 








(44) 


4 


□ 


Other (explain) 




15 


Is there a problen^ in gettin#repbrts? 


(45) 


1 


□ 


Yes 










2 


□ 


No , , 



10; 



Variable 



Questions 



Data Quality 



16 

17 



18- 



Evaluation Uses 19 



Reporting 



20 



Staffing 



21 



22 
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(State) Do you fund local programs on 
the basis of the data they submit? 

How*accurate do you feel are your data?^- 



Is your student data individualized or 
aggregated? „ ^ 



For what purpose are the MIS reports used? 



(Local) Who is responsible for doing i 
the reporting? ^ • 



How many years have you had this MIS 
job? . • 

How many years in related training? 



Response 



(46) 1 


a 


Yes 


2 


□ 


No 




1 — 1 


iJiaccu rate 


2 


□ 


2 ' 


3 


□ 


3 


• 4 




4 


5 


□ 


Accurate 


(48) 1 


□ 


Individualized 


• '2 


□- 


Aggregated 


3 


□ 


Both 



(49) 1 □ , Planning 

(50) 2 a ^ Funding 

(51) 3 □ Program decisions 

(52) 4 □ Reporting 

(53) 5 □ Needs assessments 

(54) 6 Evaluation ' 

(55) 7 □ Otlier (explain) 

(5^6) 1 □ Teachers, Counselors 

(57^ 2 q Students . ' 

(58) 3 □ Administration 

(59) 4 □ Clerical , ; 

(60) 5 □ Other (explain) 

(61-62)^ 01 □ □ One year or less 
□ □ Number of years 



(63-64) 01 □ □ ^ One year or less 
\ □ □ NumBer of years 



VariabJe 



Questions . 



23 



Disserifji nation* » 24 

■■*/■■'"' ■' " 

. • ■ " 25 

■■>■ • 

' 26 



How /nuch turnover has occurred in the MIS 
staff over the past 5 years? 



•Do ypu 'send any of the compfeted reports 
to local agencies? 

Do you receive afiy of the completed 
reports from the statef '^ ' 

Who gets these reports? 



D 
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Response 



(65) 


1 


□ 


None 




2 


□ 


Low ' 




3 


□ 


Medium ° 




4 


□ 


High 


(66) 


1 


□ 


Yes 




2 


□ 


No ^ ' . 


(67) 


1 


□ 


Yes 




2 


□ 


No ^ 


(68) 


1 


□ 


* ■ • 

Teachers 


(69) 


2 


□ 


Superintendent 


(70) 


3 


□ 


Local Vocational Director 


|71) 


4 


D 


Agency Head 


(72) 


5 


□ ■ 


Other (explain) 



